Yet Another AI Assistant

?? Hi Everyone,

I hope you're all doing great! I wanted to share a small project that I've been working on over the past month during my unemployment gap before onboarding to my new company. ??

?? It's an AI project that leverages the power of GPT and the Langchain framework to create an interactive, web-based AI companion. The AI features include:

?? Search function to scour the internet for the latest news or information

?? Wolfram-Calculator for complex mathematical calculations

?? Arxiv function to lookup and summarize academic papers, like a digital research assistant

?? Python function for coding simple Python programs

?? Wikipedia function to fetch information on any topic

?? Gmail function to search, sort, and send emails on your behalf (Still unsure about the security concern for this function as it lets my webapp scour through your email list basically :/)

?? Rayza-QA, a unique feature that allows the AI to delve into a vector text embedded Google Docs autobiography of myself, retelling any part of it that you wish to know about me. (This part was meant to be used for interviewers if they wished to know more about me after the interview time is up, turns out I never got to use it as I was already accepted to a new role)

I've split the AI into two modes, conversation mode (more lifelike but lacks the functions above) and assistant mode (more rigid but has access to functions above). You can toggle between modes by tapping or clicking the hidden button in the top right corner of the webpage

The AI companion is also equipped with live2D movements, responding to your texts with expressive body language and mouth movements.??

To top it all off, I've integrated Google Text-to-Voice, so it reads out texts in a lifelike manner! ???

It's been a joy to work on this project, and I've deployed it in case anyone wants to give it a whirl: https://portfolio-web-249407.web.app/

I'd love to hear your feedback, and please don't hesitate to suggest any features you'd like to see added. I’m always eager to learn and improve! ?? ??

Stay curious, stay inspired! ??

Best,

Rayza Mahendra

PS: you can reset your conversation by typing "!bye" in the chat

PPS: the code is still slow and unoptimized :/ sorry

Email assist function:

Email result:

Research assist function:

Rayza-QA, autobiography function: