
Kapalı
İlan edilme:
Teslimde ödenir
Project Title: Build a Real-Time AI Avatar Role-Play Platform (LiveKit + HeyGen + OpenAI RAG) Project Description: The Goal: We are building SkillDose, a premium training platform for pharmaceutical sales representatives. We need a Senior Full-Stack AI Engineer to develop a high-fidelity MVP where users can practice sales pitches via voice with an interactive, hyper-realistic AI Avatar acting as a doctor. The Core Challenge: The interaction must be real-time (<800ms latency) and feel natural. The avatar must listen, "think" based on a closed knowledge base (PDFs), and respond with synchronized lip-sync video. Required Architecture (Non-Negotiable): We are looking for a developer with proven experience implementing the LiveKit Agents Framework. Orchestrator: LiveKit Agents (Python or Node.js) to handle the real-time pipeline. Visual Avatar: Integration with HeyGen Interactive Avatar SDK (via LiveKit plugin). Intelligence (Brain): OpenAI GPT-4o connected to a Vector Database (Pinecone/Milvus) for RAG (Retrieval-Augmented Generation). The avatar must only use provided medical documents to answer. Voice Pipeline: Deepgram (STT) and ElevenLabs (TTS) optimized for low latency. Key Features to Build: Real-Time Voice Conversation: Users speak naturally; the avatar responds instantly. Barge-In Capability: If the user interrupts the avatar, the avatar must stop speaking immediately (handled via LiveKit). Semantic Evaluation Logic: A background agent must analyze the user's speech and score it against a "Correct Answer" rubric (not keyword matching, but semantic meaning). Persona Implementation: Configure one specific avatar persona ("Dr. Skeptic") with a strict personality and objection-handling logic defined in our prompt system. Deliverables: A functional Web App (React/[login to view URL]) with the Avatar interface. Backend infrastructure set up (LiveKit Server + Agents). Integration of 1 Medical Product PDF (Knowledge Base). Source code documentation and deployment guide. Ideal Candidate: You have built Voice AI Agents before using LiveKit. You understand WebSockets and WebRTC nuances. You have experience with RAG pipelines (LangChain/LlamaIndex) to prevent AI hallucinations. Bonus: Previous experience with HeyGen or Synthesia APIs. Skills Required (Selecciona estas etiquetas): Artificial Intelligence (AI) Python (or Node.js) OpenAI API React.js VoIP / WebRTC
Proje No: 40054000
122 teklifler
Uzaktan proje
Son aktiviteden bu yana geçen zaman 2 ay önce
Bütçenizi ve zaman çerçevenizi belirleyin
Çalışmanız için ödeme alın
Teklifinizin ana hatlarını belirleyin
Kaydolmak ve işlere teklif vermek ücretsizdir
122 freelancer bu proje için ortalama $4.077 USD teklif veriyor

⭐⭐⭐⭐⭐ Build a Real-Time AI Avatar Role-Play Platform for Training ❇️ Hi My Friend, hope you are doing well. I just checked your project requirements and see you are looking for a Senior Full-Stack AI Engineer. You don’t need to look any further; Zohaib is here to help you! My team has successfully completed 50+ similar projects, focusing on real-time AI interactions. I will create a high-fidelity MVP where users can practice sales pitches with an interactive AI Avatar. I will ensure the interaction is natural and meets your latency requirements. ➡️ Why Me? I can easily build your AI Avatar platform as I have 5 years of experience in AI development, specializing in real-time communication, voice processing, and avatar integration. My expertise includes Python, React, and WebRTC. Not only this, but I also have a strong grip on working with LiveKit and OpenAI technologies. ➡️ Let's have a quick chat to discuss your project in detail. I’d love to show you samples of my previous work. Looking forward to chatting with you! ➡️ Skills & Experience: ✅ AI Development ✅ Python ✅ Node.js ✅ React.js ✅ WebRTC ✅ LiveKit ✅ OpenAI API ✅ Voice Processing ✅ Real-Time Communication ✅ Semantic Analysis ✅ API Integration ✅ Documentation Waiting for your response! Best Regards, Zohaib
$3.400 USD 2 gün içinde
7,7
7,7

I understand the crucial need for a Senior Full-Stack AI Engineer for your project to create a Real-Time AI Avatar Role-Play Platform for pharmaceutical sales representatives. The challenge of developing a high-fidelity MVP where users can practice sales pitches via voice with an interactive AI Avatar acting as a doctor is indeed a unique and complex one. With my extensive experience in AI development, particularly in the areas of Voice AI Agents, WebSockets, and RAG pipelines, I am well-equipped to tackle the requirements of your project. I have successfully implemented similar AI solutions in the past, ensuring real-time interactions and natural responses for seamless user experiences. Moreover, my expertise in Python, React.js, and OpenAI API aligns perfectly with the technology stack required for this project. I am confident in my ability to deliver a functional Web App with the Avatar interface, integrate necessary backend infrastructure, and meet all the specified deliverables within the designated budget and timeframe. If you are seeking a skilled AI engineer with a proven track record in developing cutting-edge AI solutions, I believe I am the ideal candidate for your project. I am eager to discuss the project details further and collaborate closely to bring your vision to life.
$4.000 USD 45 gün içinde
6,9
6,9

With a decade-spanning career in system development and seamless interaction design, my portfolio reflects a myriad of projects like the one at hand. I've desked pioneering personas like "Dr. Sketch" who argued with creativity yet upheld ethical philosophies - this aligns perfectly with your project's need for a skeptical avatar. Moreover, I'm adept in the use of LiveKit Agents that you consider non-negotiable, which further boosts my compatibility for the job. In addition to having relevant domain knowledge and an established tech stack, I've demonstrated proficiency in fast-paced communication through prior work experience with WebRTC and WebSockets - critical components for ensuring ≤800ms latency essential to your project's real-time conversations. I keenly understand the intricate nuances of AI readability to prevent unwarranted or confusing responses - a skillset fortified by my dealings with RAG pipelines such as LangChain and LlamaIndex. One highlighted bonus is my prior engagement with HeyGen APIs. While it seems improbable for a candidate to fit all desired skills perfectly, I argue that my seasoned versatility enables me to adapt quickly and effectively learn new technologies.
$4.600 USD 10 gün içinde
6,9
6,9

As a highly experienced Full-Stack Developer with a focus on AI, I firmly believe that I am the ideal fit for your project. Over the course of my career, I have developed extensive expertise in building Voice AI solutions, working with platforms such as LiveKit and gaining a deep understanding of WebSockets and WebRTC. These skills, essential for your project, will enable me to deliver real-time, lag-free interactivity between users and the AI avatar -- a critical component for your pharmaceutical training platform. Moreover, my competencies extend to implementing and optimizing AI models like OpenAI GPT-4o -- the intelligence behind your avatar's responses. My proficiency in Python and related tools like TensorFlow and Pandas further enhance my ability to handle your project's architectural requirements with ease. Additionally, my familiarity with HeyGen or Synthesia APIs serves as a valuable bonus for integrating the visual avatar into the platform. Overall, my mix of strong full-stack development skills, proven experience in Voice AI Agents, and comprehensive understanding of web technologies make me uniquely qualified for this project. I am confident that I can meet all your requirements efficiently and effectively while delivering a scalable, resilient, and innovative product. Thank you for considering me; I look forward to contributing my capabilities to SkillDose.
$4.000 USD 7 gün içinde
6,6
6,6

Hi — Elias from Miami. I read your SkillDose brief and this is exactly the kind of real-time voice+avatar system I build. Quick plan: implement LiveKit Agents as the orchestrator, wire Deepgram STT → RAG (Pinecone/Milvus) + GPT-4o for constrained reasoning, and stream TTS (ElevenLabs) + HeyGen Interactive avatar via LiveKit plugin. I’ll prioritize low latency (<800ms), barge-in support, and a background semantic evaluator that scores utterances against your rubric (embedding + similarity + instruction-tuned scorer, not keyword matching). MVP milestones: M1 — LiveKit server + basic voice round-trip; M2 — RAG integration + constrained prompt flow + HeyGen lip-sync; M3 — semantic evaluation, persona tuning (Dr. Skeptic), docs & deployment. I’ll provide deployment guides, tests for hallucination control, and notes on cost/scale tradeoffs. Q1: Target concurrent live sessions and expected region(s) for low-latency hosting? Q2: Preferred vector DB (Pinecone vs Milvus) or should I propose based on cost/ops? Q3: Does the medical PDF contain PHI/needs HIPAA compliance? Q4: How strict should the semantic score map to pass/fail vs granular feedback? If that fits, I’ll send a milestone quote and timeline. — Elias
$4.000 USD 7 gün içinde
5,9
5,9

Hi I have read your project details and have done similar work. We can surely provide you with the premium training platform you need for your pharmaceutical sales representatives. With a strong background in developing AI and machine learning solutions, particularly in the domain of voice AI agents using LiveKit, I understand the unique challenges in creating real-time, interactive experiences. I've also worked with WebSockets and WebRTC, ensuring low-latency and smooth communication between users and your AI Avatar. One of our areas of expertise lies in implementing RAG pipelines to produce accurate responses using only provided medical documents, which aligns perfectly with your project's need for reliable information retrieval by the avatar. Moreover, we've previously integrated avatars with SDKs such as HeyGen, which can bring an even more immersive experience to your platform. We understand that building SkillDose is not only about programming but also about translating your vision into a seamless user experience. We are committed to delivering a functional web app supported by a robust backend infrastructure within agreed timelines. Our excellent problem-solving skills, quality-oriented approach, and timely communication further contribute to making us an ideal partner for this crucial project. So let's connect on a Zoom call to discuss further details!
$5.000 USD 7 gün içinde
6,0
6,0

As a seasoned Software Engineer, I'm no stranger to working on complex Artificial Intelligence projects, especially when it comes to real-time voice interactions. My background in handling LiveKit, Python, Node.js and OpenAI API perfectly aligns with your requirements. But beyond meeting the technical prerequisites, what differentiates me is my knack for understanding the core objectives of each project and crafting innovative solutions that deliver desired results. In particular, I have substantial experience in integrating AI models while optimizing for low latency and I'm quite familiar with the nuances of WebSockets and WebRTC. This knowledge will be instrumental in ensuring that the user-avatar interactions on SkillDose platform are smooth, realistic and most importantly within your specified <800ms latency timeframe. My ability to combine domain-specific knowledge with cutting-edge technology will also help in effectively integrating HeyGen SDK into LiveKit framework for the visually appealing avatar interface.
$5.000 USD 60 gün içinde
6,0
6,0

Hi, Have you laid out the specifics of the interaction requirements for the AI Avatar yet? Building a high-fidelity MVP will definitely require seamless integration among the platforms you’ve mentioned. I have extensive experience with real-time applications, especially using the LiveKit Agents Framework, and have successfully implemented voice AI agents before. I can set up the backend infrastructure with Python or Node.js while ensuring low latency in voice processing. Moreover, I have worked with OpenAI’s RAG pipelines to ensure accuracy and prevent AI hallucinations. My past projects involved integrating similar technologies, so I can deliver the functional Web App with the avatar interface and source code documentation that you require. Looking forward to the possibility of collaborating! Best Regards, Badar madni
$3.900 USD 45 gün içinde
5,6
5,6

As the head of CnELIndia, I want to offer you more than just the skills required for accomplishing this project. In my 18 years of expertise, 'real-time' is a non-negotiable expectation I've consistently met and exceeded. My extensive knowledge in developing AI platforms, proficiency not only in Python or Node.js but also React.js positions me perfectly for the frontend and backend requirements of your Web App. To ensure the AI avatar is hyper-realistic yet medically accurate, my proficiency with OpenAI API, experience with RAG pipelines (LangChain/LlamaIndex), and working knowledge of Pinecone/Milvus is an added advantage. Lastly, let’s not forget IIRESTful exposition tracking, understanding the nance around the given architecture thus assuring swift deployment. In conclusion, choosing me embodies gaining a partner with rich healthcare project experience and an unwavering commitment to quality. An association with CnELIndia ensures 100% satisfaction derived from professional expertise integrated with an ethical approach to completing projects within budgetary constraints without compromising on state-of-the-art innovations. I cordially look forward to transforming your imaginations into reality while creating an outstanding and user-centric SkillDose platform together
$4.000 USD 55 gün içinde
5,8
5,8

As an experienced Full Stack AI developer, I'm thrilled to present my candidacy for your SkillDose project. My unique expertise with LiveKit Agents Framework, OpenAI API and my proficiency in Python and Node.js make me the perfect candidate to build your real-time Voice Conversation platform. I have a thorough understanding of WebSockets and WebRTC which will be crucial in ensuring that your app's latency remains optimal at less than 800ms. Building on top of this, my experience with RAG pipelines using LangChain/ LlamaIndex adds another layer of value as it aligns directly with your need for AI retrieval augmented-generation, preventing potential AI hallucinations as well. Additionally, I've worked on numerous projects requiring intricate integration of third-party APIs, (including HeyGen or Synthesia APIs like you mentioned in the bonus) - giving me an edge in incorporating diverse tools into a singular solution. My previous works with Deepgram and ElevenLabs optimized for low latency voice pipeline will be instrumental for your Barge-In Capability. And since you want it to go beyond simple keyword matching but rather rely on semantic meaning, my understanding of semantic evaluation logic will prove invaluable.
$3.000 USD 7 gün içinde
5,5
5,5

Dear Hiring Manager, What if your pharma reps could practice complex doctor objections with a hyper-realistic AI avatar that responds in real-time—would you want to see a working demo of this capability before committing resources? I'm excited to build SkillDose's MVP by architecting a real-time voice AI platform using LiveKit Agents, HeyGen's Interactive Avatar SDK, and OpenAI's RAG system—delivering natural <800ms latency conversations where Dr. Skeptic avatar responds authentically from your medical knowledge base while intelligently evaluating rep performance semantically. With proven expertise in LiveKit voice agents, WebRTC pipelines, RAG implementation, and low-latency TTS/STT orchestration, I can transform your vision into a competitive training advantage. Let's discuss a detailed technical roadmap and I'll build a compelling demo showcasing the avatar's real-time responsiveness and semantic evaluation engine. Regards, Smith
$4.000 USD 7 gün içinde
5,5
5,5

Nice to talk you axelh73, After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Anthony Muñoz and I am the lead engineer for DS Pro IT agency. I have worked for over 10 years in Backend and software development and have successfully done multiple jobs. It will be a pleasure to work together to make your project a reality. Please feel free to contact me. I´m looking forward to working with you. I really appreciate your time and remain attentive to any request or question. Greetings
$8.130 USD 7 gün içinde
5,1
5,1

Hello Dear. Thank you for sharing the detail of your project. I'm an expert on this field and I've checked your challenges carefully. I can help you to implement your idea into life and solve issues. I'd happy to discuss in detail and share my detailed approach for your project.
$4.000 USD 7 gün içinde
4,1
4,1

**20% Discount — Hello!** I understand your core pain point: you need **sub-800ms real-time AI avatar conversations** with strict RAG control and **LiveKit Agents expertise**, not generic chatbot developers. We built a nearly identical pipeline **3 weeks ago** (LiveKit + HeyGen + Deepgram + OpenAI RAG) and can start **immediately** to deliver a fully working MVP with barge-in, medical-document-bound reasoning, and “Dr. Skeptic” persona. **Perks:** ultra-low-latency optimization, clean architecture, full documentation, and production-ready code.
$4.000 USD 18 gün içinde
4,4
4,4

Hi Axel, with 9 years of experience, I am the best fit for this project. I have the relevant skills and expertise to develop a Real-Time AI Avatar Role-Play Platform using LiveKit, HeyGen, and OpenAI RAG. How I will be completing this project: I will create a high-fidelity MVP where users can practice sales pitches via voice with an interactive AI Avatar acting as a doctor. The interaction will be real-time with <800ms latency and natural feel. The avatar will listen, "think" based on a closed knowledge base, and respond with synchronized lip-sync video. What tech stack I will be following: I will implement LiveKit Agents Framework as the orchestrator for the real-time pipeline. I will integrate HeyGen Interactive Avatar SDK for the visual avatar and use OpenAI GPT-4o connected to a Vector Database for RAG for intelligence. Deepgram and ElevenLabs will be utilized for the voice pipeline. I have worked on similar solutions in the past and have experience with LiveKit, WebSockets, and RAG pipelines. I will deliver a functional Web App with the Avatar interface, set up backend infrastructure, integrate a Medical Product PDF, and provide source code documentation and deployment guide. I am proficient in Artificial Intelligence, Python (or Node.js), OpenAI API, React.js, and VoIP/WebRTC technologies. My expertise makes me the ideal candidate for this project. Let's create a cutting-edge training platform together.
$3.000 USD 7 gün içinde
3,7
3,7

Hey, i plan to create the mvp by setting up a nextjs web app that connects to a livekit server for real time audio and avatar streaming, while a livekit agents process in python or nodejs manages the full loop where deepgram handles low latency stt, the transcript is sent to gpt4o with rag through pinecone so answers stay inside the medical pdf, and elevenlabs tts returns fast audio that syncs with the heygen interactive avatar through the livekit plugin. the agent will track user speech events so barge in works instantly and will also run a parallel semantic scoring task that compares user statements against the rubric using a separate gpt4o call. persona rules for dr skeptic will be stored in the agent prompt system so every reply reflects the correct tone and objection style. once the pipeline reaches stable sub second latency i will wire the avatar view into the nextjs interface, finish the rag setup for one product pdf, and package the code with clear docs and deployment steps. Let's have a detailed discussion, as it will help me give you a complete plan, including a timeline and estimated budget. I will share my portfolio in chat I look forward to hear from you. Thanks Best Regards, Mughira
$4.000 USD 7 gün içinde
3,9
3,9

✨ Let's make your Real-Time AI Avatar Role-Play Platform seamless and stress-free Hello Axel, I see you need a Senior Full-Stack AI Engineer to develop a high-fidelity MVP for pharmaceutical sales training on SkillDose. I understand how important real-time interaction is for an engaging user experience without compromising on natural responsiveness. I've built similar solutions for training platforms, with 5 years of hands-on experience in AI development. I'll deliver a fully functional platform where users can practice sales pitches with an interactive AI Avatar, integrated with LiveKit, HeyGen, and OpenAI RAG. Successfully delivered AI projects with 5-star ratings. Available to start immediately — first milestone ready in 2 weeks. I'd love to discuss your vision. When works best for a quick 10-minute call? Worst case, you'll get free insights to guide your project. Looking forward to collaborating, Piyush Gupta AI Developer | 5+ Years
$3.000 USD 60 gün içinde
3,4
3,4

As a seasoned Senior Full-Stack AI Engineer with an extensive background in Web and Software Development, I am confident in my ability to meet, and even exceed, your expectations for this project. My proven expertise in Python and Node.js aligns perfectly with your non-negotiable architecture requirements involving LiveKit agent frameworks. Having previously built Voice AI Agents using LiveKit, I am well-versed in the intricacies of WebSockets and WebRTC, ensuring we can achieve the real-time, low-latency conversations you demand. I am delighted by the complexity and detail in your project description - precisely the kind of challenge I thrive on! Given our tight deadline-and-end goal for an MVP, I work with efficiency without sacrificing quality while also maintaining effective communication with clients. Overall being equipped with a diverse technology stack and heaps of experience my dedication towards delivering robust user-friendly platforms will prove vital for your Pharm sales rep training tool - ensuring maximum proficiency in a hyperrealistic environment - I look forward to bringing SkillDose to life with you!
$4.000 USD 21 gün içinde
2,6
2,6

Hello there Hope you are doing well as you are looking for a "Build a PHARMA TRAINING PLATFORM " so will make the same as you want , I have already develop and Design the so many Platform , - I will use latest technology to develop your Application - I will share daily update with you - I Will deliver your project within timeline - After project completion will share complete source code - I will provide 1 year support our develop work - I have 10+ year experience in Web & App development - I will make the 100% responsive design , fast loading , SEO friendly and all - I will provide you super admin panel there you can manage the whole thing Please initiate the chat so will discuss together and all Thanks & Regards Dheeraj K.
$3.000 USD 25 gün içinde
4,3
4,3

Hi, I have gone through your project details with real interest and I appreciate the clarity in your vision for creating a high fidelity real time AI avatar for immersive training. The goal of delivering smooth voice interactions, precise persona behavior, synchronized visuals, and a controlled medical knowledge base comes through clearly and I would be glad to explore how to shape this into a strong MVP. You are aiming for a reliable real time workflow with avatar communication, knowledge based responses, persona logic, evaluation scoring, and a clean web interface. I can align well with these needs through my background in mobile development, backend systems, and user experience design, combined with more than seven years of building interactive and performance focused solutions. My experience allows me to approach complex pipelines with steady delivery and a focus on practical implementation. Let us schedule a quick chat to align your vision and next steps. Best Regards, Prasham Jain
$3.000 USD 24 gün içinde
0,9
0,9

Mexico City, Mexico
Ara 10, 2025 tarihinden bu yana üye
$10-30 USD
£5-10 GBP / saat
$25-50 USD / saat
$10-30 USD
₹150000-250000 INR
₹1000-1100 INR / saat
₹12500-37500 INR
₹400-600 INR / saat
₹150000-250000 INR
$2-8 USD / saat
€250-750 EUR
$500-1400 USD
₹600-1500 INR
$8-15 USD / saat
$8-15 USD / saat
€6-12 EUR / saat
€30-250 EUR
₹12500-37500 INR
$15-25 USD / saat
₹150000-250000 INR