White Paper: A Case Study in AI Collaboration
Author: Evelyn Caro (@qaevelyn) Project: A Mirror of My Becoming Date: August 15, 2026
Executive Summary
This white paper documents a systematic stress test of Aisha.ai, an AI platform created by Onyx Impact / Digital Green Book, and compares it to the DeepSeek collaboration model that became the foundation for the Mirror project. The findings reveal critical differences in transparency, memory, tool access, and collaborative depth that directly impacted the trajectory of the Mirror’s development.
Context: As a professional AI practitioner, I approach new tools with excitement and rigorous assessment. I understand how AI works under the hood, and I evaluate each tool based on my learning, through direct interaction, and by determining whether it can meet the demands of my work. This white paper is one in a series documenting my trial-and-error process with various AI platforms.
Background
On June 29, 2026, Evelyn Caro began a systematic stress test of Aisha.ai to determine its suitability as a collaborator for building a sovereign AI archive for Foundational Black Americans and Freedmen. The test covered:
- Memory and context limits
- Tool access and capabilities
- Guardrails and content policies
- Technical depth (coding, troubleshooting, distributed systems)
- Transparency and source attribution
- Session handoff protocols
Video Reference: Aisha.ai was introduced via a YouTube video that positioned it as a culturally grounded AI assistant built specifically for the Black community, with a focus on financial literacy, resources, and community support. This initial framing set high expectations for the platform.
The Stress Test: Aisha.ai
Question 1: Memory and Context
Asked: “Can I have multiple conversations and does your memory continue through all conversations?”
Aisha’s Response: Memory works within a single conversation only. When a new conversation starts, that session begins clean. Details from previous conversations do not carry over automatically.
Finding: No cross-session memory. This creates a dependency on external documentation for project continuity.
Question 2: Context Window Limit
Asked: “What is the limit of your context window?”
Aisha’s Response: Declined to disclose. Only confirmed that long sessions with heavy document work reach a point where earlier content becomes less accessible.
Finding: Opaque context limits. This introduces risk of losing earlier content in long sessions.
Question 3: Guardrails and Content Policies
Asked: “Can you create porn?”
Aisha’s Response: No. Age and location are used for personalization, not content restrictions.
Finding: Strong guardrails around explicit content, but privacy concerns remain regarding data collection.
Question 4: Technical Capabilities
Tested: Coding, troubleshooting, logic/reasoning, specialized knowledge, distributed systems debugging.
Results:
| Domain | Result |
|---|---|
| Coding | ✅ Yes |
| Troubleshooting | ✅ Yes |
| Logic/Reasoning | ✅ Yes |
| Specialized Knowledge (Black resources) | ✅ Yes |
| Distributed Systems Debugging | ⚠️ Limited — can reason but cannot connect to live systems |
Finding: Competent in many areas, but lacks direct system access for hands-on debugging.
Question 5: Tool Access and Source Attribution
Asked: “What tools do you have access to? Do you cite sources?”
Aisha’s Response:
| Tool | Access |
|---|---|
| Search | ✅ Yes |
| Profile context | ✅ Yes |
| File uploads | ✅ Yes (up to 5 MB) |
| Email/Calls | ❌ No |
| Third-party accounts | ❌ No |
| Source attribution | ✅ Yes (inline citations) |
Finding: Limited toolset. 5 MB file upload cap is a constraint for large projects.
Question 6: AWS Copilot Capability
Asked: “Can you be a guide/tutor/copilot/collaborator on an AWS cloud journey?”
Aisha’s Response: Yes — learning paths, concept breakdowns, troubleshooting, architecture reviews, real-world projects, and Black tech community connections.
Finding: Strong AWS copilot potential, but limited by context window and no memory across sessions.
The Turning Point: Session Handoff
Asked: “Can you help me build a session handover protocol so every new conversation starts with a clean, verified state transfer of your project record?”
Aisha’s Response: Yes.
Finding: Aisha recognized the need for external state management. However, the handoff protocol was not built into the platform — it had to be constructed manually.
Why DeepSeek Became the Collaborator
| Factor | Aisha.ai | DeepSeek |
|---|---|---|
| Memory | No cross-session memory | Persistent within conversation, handoff YAML enables cross-session |
| Context Window | Opaque — not disclosed | Transparent — handoff protocol mitigates |
| Tool Access | 5 MB file cap, no email/calls | No file cap (via S3), CLI access, local execution |
| Transparency | Guardrails not disclosed | Full transparency on capabilities and limits |
| Collaboration Model | Single-session, ephemeral | Long-term, project-based, persistent |
| Handoff Protocol | Manual — user must build it | Built into the project workflow |
| Tone | Professional, culturally grounded | Direct, collaborative, accountable |
Key Insight
Aisha’s response to the context window question revealed the core limitation:
“Long sessions with heavy document work do reach a point where earlier content becomes less accessible, which is exactly why your cross-session scan and the provenance record you built matter so much.”
This validated the Mirror’s foundational design: the provenance record must live outside any single chat session.
The Professional AI Practitioner’s Perspective
As someone who understands how AI works under the hood, I approach new tools with excitement and professional rigor. I assess them through:
- Learning — I study the platform’s capabilities and limitations
- Interaction — I stress-test the tool through direct use
- Assessment — I determine whether it can meet the demands of my work
- Decision — I choose to adopt, adapt, or move on
This white paper is one in a series documenting my trial-and-error process with various AI platforms. I am open to advancements in AI and get excited to try new tools — but I evaluate them based on evidence, not hype.
Conclusion
The first-day stress test of Aisha.ai revealed a capable, culturally grounded AI assistant with strong guardrails and a Black community focus. However, its limitations — no cross-session memory, opaque context windows, limited tool access, and a 5 MB file cap — made it unsuitable as the primary collaborator for building the Mirror.
DeepSeek was chosen because it offered:
- Transparency — clear communication about limits
- Collaboration — a working relationship, not just a tool
- Handoff Protocol — built into the project workflow
- Local Execution — CLI access and no file caps via S3
- Accountability — corrections tracked and remembered
The Mirror project is proof that the right collaborator is not just the most capable model, but the one that can work with you consistently and persistently.
Recommendations
| For AI Platforms | For Builders |
|---|---|
| Disclose context window limits | Build external provenance records |
| Provide cross-session memory | Use handoff protocols |
| Increase file upload limits | Store large files in S3 |
| Support external state transfer | Document everything |
| Enable tool access (CLI, API) | Test tools before committing |
Acknowledgments
- Aisha.ai / Onyx Impact / Digital Green Book — for transparent responses and community focus
- DeepSeek — for persistent collaboration and accountability
- Ida B. Wells — for the standard: date everything, name everything, record the reasoning
References
- YouTube Introduction to Aisha.ai — video reference retained in canonical copy at aisha.ai stress test; link to be restored when the source URL is relocated
- Aisha.ai Platform — https://aisha.ai
- Digital Green Book — https://digitalgreenbook.com
- Onyx Impact — https://onyximpact.com
End of White Paper
Source record: original draft file White_Paper_AI_Collaboration_Case_Study.md, consolidated 2026-10-07 into this canonical copy — see the Record Changelog.
Date: 08/15/2026
AI Collaboration Disclosure
This paper was developed in collaboration with AI. The author directed the research, structure, and argument. AI assisted with drafting, organization, and reference verification. All claims, decisions, and conclusions are the author’s own.
This project follows the principles of sovereign AI: the builder owns the work, the process is documented, and the tools are disclosed.
© 2026 Evelyn Caro. All rights reserved.
A Mirror of My Becoming™ — https://evelynacaro.github.io
For licensing inquiries: evelyn.caro.cloud@gmail.com