CloakAI

Artificial Intelligence / Machine Learning

About CloakAI

CloakAI is an AI-driven tool designed to provide Digital Cloak employees with swift and accurate responses to compliance and IT-related queries. Leveraging the power of Artificial Intelligence (AI) and Machine Learning (ML), CloakAI ensures that users benefit from these technologies in a secure, locally-hosted environment, safeguarding sensitive data. The platform is built on Meta's open-source Llama3 model, offering extensive customization options while maintaining a user-friendly web interface through Open WebUI. This setup is hosted on a Debian 12 desktop, enabling secure remote access within the organization's network.


Through the CloakAI project, I gained valuable insights into the effective use of Artificial Intelligence (AI) and Machine Learning (ML) in secure environments. The primary aim was to create a secure, locally hosted AI platform that organizations can use within the confines of the company, ensuring it does not extend to any external networks. This allowed the platform to handle sensitive information, including Personally Identifiable Information (PII), without compromising security. I learned how to implement the Llama3 model to create a powerful yet secure tool for aiding compliance and IT support. This experience emphasized the importance of designing a user-friendly, interactive interface, which I achieved using Open WebUI. It was critical to ensure that the admin panel was intuitive while still offering powerful customization options to manage users efficiently. Additionally, I developed a deeper understanding of security best practices, particularly in terms of managing data, setting user permissions, and keeping the system isolated from external networks to mitigate risks. I also learned how to set up secure remote access within a local network, ensuring that users could easily access the system while maintaining strict control over who had access to its functionalities.

Skills Utilized

AI & MLSystem AdministrationNetworkingSecurityGovernment ComplianceDockerLlama3OpenWeb-UIDebian12

What I Learned

AI/ML Integration: Implemented the Llama3 model for robust and customizable AI capabilities. Secure Data Handling: Ensured data security by utilizing a locally-hosted model with no external internet connectivity. Web Development: Developed a streamlined web interface using Open WebUI, focused on user accessibility and admin control. System Administration: Set up and managed a secure Debian 12 server environment with remote access configurations. User Management: Created an admin panel with advanced features like user permissions, restrictions, and multi-admin support.


Through the development of CloakAI, I learned the importance of balancing powerful AI/ML capabilities with strict data security measures, ensuring that the organization can reap the benefits of AI without compromising sensitive information. I also gained experience in integrating user-friendly interfaces with complex backend systems, and the significance of effective user management in a secure, AI-powered environment. Finally, I enhanced my understanding of deploying and maintaining AI systems in a secure, isolated network, ensuring reliable remote access for users.