Comparing llama_index(llama2) vs langchain(llama3) for a University Prospectus Chatbot

We have been playing with the new Llama3 from Meta , testing which model is the best with our AI avatars.

In this test we are using Liverpool John Moores University prospectus as the data within the RAG (Retrieval Augmented Generation) meaning a potential student can ask questions on any of the courses within the University and get an intelligent answer back.

Comparing the results is interesting. llama_index with Llama2 gave better results than that of Langchain with Llama3.... well we think they are better in response to 'conversational' style, but it is worth stating that when we say 'better' it is purely observationally better - the Llama3 model might be perfect in what it was designed for.

The output below is the question we asked, the result, and at the end is the time it took to generate.

>> hello my name is bob
////////////////////////////

hello bob!  it's great to meet you!  liverpool john moores university (ljmu) is an amazing place to learn and grow, and i'm happy to help answer any questions you may have!  what brings you here today? are you interested in studying at ljmu? | 1.3s        

langchain(llama3)

>> hi my name is bob
////////////////////////////

I'm happy to help! However, I need more context about who you are and what brings you to Liverpool John Moores University. Could you please share a bit more about yourself? | 1.2421236038208008s        

llama_index(llama2)

>> list me some computing courses
////////////////////////////

of course!  liverpool john moores university (ljmu) offers a wide range of computing courses that can help you unlock your potential in the tech industry! here are some of the computing courses we offer:
1. bsc (hons) computer science: this course will provide you with a solid foundation in computer science, covering topics such as programming, algorithms, data structures, software engineering, and artificial intelligence. 
2. bsc (hons) computer security: this course will teach you how to protect computer systems and networks from cyber threats, including malware, viruses, and hacking. you'll learn about security protocols, cryptography, and network security. 
3. bsc (hons) data science: in this course, you'll learn how to collect, analyze, and interpret large datasets, using tools such as python, r, and sql. you'll also learn about machine learning, data visualization, and statistical analysis. 
4. bsc (hons) artificial intelligence: this course will provide you with a deep understanding of ai concepts and techniques, including machine learning, natural language processing, and computer vision. you'll learn how to develop and implement ai systems using programming languages such as python and java. 
5. bsc (hons) software engineering: this course will teach you how to design, develop, and test software systems using agile methodologies and tools such as java, c++, and python. you'll also learn about software testing, debugging, and maintenance. 
6. bsc (hons) web development: in this course, you'll learn how to design and develop websites and web applications using html, css, javascript, and frameworks such as react and angular. 
7. bsc (hons) mobile application development: this course will teach you how to design and develop mobile apps using programming languages such as java and swift, and frameworks such as android and ios. 
8. bsc (hons) cyberpsychology: this course will explore the psychological aspects of technology use and the impact of technology on individuals and society. you'll learn about human-computer interaction, online behavior, and cybersecurity. 
these are just a few of the computing courses we offer at ljmu. if you have any specific questions or would like more information, feel free to ask! | 7.0        

langchain(llama3)

>> list me some computing courses
////////////////////////////

According to the text, Liverpool John Moores University offers the following Computing courses:

* BSc (Hons) Mathematics

Note that this is not a comprehensive list of all computing-related courses offered by the university. If you're looking for more information on specific courses or programs, I recommend visiting the university's website or contacting their admissions office directly. | 2.0480778217315674s        

llama_index(llama2)

>> tell me about the last one
////////////////////////////

of course!  the last course i mentioned is the bsc (hons) cyberpsychology at liverpool john moores university.  this course is designed to provide students with a deep understanding of the psychological aspects of technology use and the impact of technology on individuals and society. 
the course covers a range of topics, including human-computer interaction, online behavior, and cybersecurity.  students will learn how to analyze and evaluate the psychological factors that influence technology use and how to design and develop technology that takes into account these factors. 
the course is taught by experienced academics and practitioners in the field of cyberpsychology, and students have access to state-of-the-art facilities and research opportunities. 
graduates of the bsc (hons) cyberpsychology course can pursue careers in areas such as technology design, online behavior analysis, and cybersecurity. 
do you have any specific questions about this course? | 3.68        

langchain(llama3)

>> tell me more about that course
////////////////////////////

According to the provided information, there is no specific mention of the BSc (Hons) Mathematics course at Liverpool John Moores University. However, I can suggest that you visit the university's website or contact their admissions team directly for more information on this course.

Additionally, it seems that the provided text focuses on showcasing the various courses offered by Liverpool John Moores University, including Pharmacy, Physical Education, and other programs. If you have any specific questions about a particular course, feel free to ask! | 2.4138801097869873s