Session: 2 for 1: The Developers’ Framework for Content Creation / Building Efficient Local AI Assistant Apps on Edge and Consumer Devices
Gabriel L. Manor: The Developers’ Framework for Content Creation
Content creation is an appealing task for developers, whether it’s a blog, video, tutorial, or talk. Developers genuinely enjoy producing content. However, there are common challenges that often arise, such as: “What should I create?” and “When do you have time for it?”
Fortunately, the answer is not as complex as it may seem.
In this talk, I will share a clear and accessible framework designed for developers who aspire to embark on their content creation journey. I won’t just provide theoretical words; I’ll also share from my personal journey into content creation and developer marketing roles.
Paula Ramos: Building Efficient Local AI Assistant Apps on Edge and Consumer Devices
This talk outlines the development of a cutting-edge chatbot application tailored for mobile processors, featuring advanced contextual awareness and a streamlined multimodal pipeline. Leveraging the OpenVINO™ Toolkit and PyTorch on an AI PC, the system demonstrates how to achieve an end-to-end experience characterized by low latency, ensuring real-time interactions that are both meaningful and efficient. Through meticulous optimizations at every stage, including data compression and intelligent application deployment, the chatbot operates within a multi-architecture framework utilizing advanced models such as Whisper and Llama3. Furthermore, the study addresses deployment challenges and the application of these models across various industry use cases, particularly highlighting the use of Whisper to enhance quality control in virtual AI Assistants and integrating Llama3 with RAG to create engaging customer experiences.
