Perplexity: Sonar 8x7B Online is a large language model (LLM) developed by Perplexity AI, which provides real-time access to the internet and up-to-date information.
This online LLM aims to overcome key limitations of many existing LLMs, such as the inability to provide up-to-date information and a tendency to hallucinate inaccurate facts. They can be accessed through the pplx-api and Perplexity AI’s LLM playground.
Conception
According to the creator’s summary, Perplexity: Sonar 8x7B Online is the result of fine tuning Llama-2 70B, together with an in-house search technology.
(..) Our in-house search, indexing, and crawling infrastructure allows us to augment LLMs with the most relevant, up to date, and valuable information.
Model Card
| LLM name | Perplexity: Sonar 8x7B Online |
| Model size | Around 150B |
| Required vRAM (GB) | 29.4 |
| Context length | 4096 |
| Supported languages | en |
| Maintainer | Perplexity AI |
Usage Examples
Perplexity: Sonar 8x7B Online is designed to overcome limitations of most LLMs in terms of up to date information.
Up-to-date calls
The publicly available template Chasing Calls from Accelerators and VC requires up to date information.
Using the following prompt:
Please give me a long list of accelerators and venture capital funds in latin america, along with some benefits and requirements for applying, and also deadlines. Focus on those that target in the following: solutions for agriculture. Consider only those that are open in the 12 months.
The model answers with a list of accelerators and VC funds, although it makes clear that information of requirements and deadlines are not available from the search results. However, the results are useful enough because they give plenty of chances to the potential applicant.
Changing the region of interest:
Please give me a long list of accelerators and venture capital funds in US, along with some benefits and requirements for applying, and also deadlines. Focus on those that target in the following: solutions for agriculture. Consider only those that are open in the 12 months.
The resulting list is much more detailed, possibly because the US has a wider offer of accelerator and VCs supporting specifically projects related to agriculture.
Consultancy online
Another template that has Perplexity: Sonar 8x7B Online as default model is Business Consultant to Start Your Company. In this case, a large prompt is used to generated more detailed results:
Act as a seasoned business consultant and strategist, proficient in company formation and operations across various industries and markets.
Your task is to deliver a comprehensive guide for establishing a business in a given country. With an initial team comprising some partners, and a given budget, lay out a strategic plan that includes:
Allocation of roles and responsibilities between the founders, based on presumed skills and interests.
Investment strategies tailored for a business and advice on cost-effective practices to maximize the value of the initial budget.
Recommendations on key positions required, with a summary of their roles and estimated market-competitive salary ranges for each.
Essential documentation and legal formalities that are necessary for the business to operate compliantly within the given country.
Insight into when and why seeking additional funding through loans could be advantageous for business growth and sustainability.
Ensure you provide:
An actionable step-by-step plan for the division of labor and initial steps in business development.
Prudent advice on initial investments focusing on must-have versus nice-to-have expenses.
A list of essential personnel, considering the scale of the operation and the nature of the business, with salary guidelines according to country’s standards.
A detailed checklist of legal and regulatory obligations to securely establish the business in the given country.
Financial insights tailored to the lifecycle of a type of business, including a risk-benefit analysis of obtaining loans at various stages.
Please enclose your variables as shown: ” Generative AI SaaS “, ” USA “, ” 3 “, ” USD 100.000 “.
This structured approach will ensure that I, along with my partners, can make informed decisions and create a sustainable foundation for our venture.
The resulting answer is very detailed. Possibly, most of the details might be well generated by other LLMs, but the online feature is assumed to be useful concerning salary ranges and legal documentation.
Comparison to other models
Perplexity: Sonar 8x7B Online has a very powerful online feature that enhances the possibilities of the base model Llama-2 70B. Other LLMs like GPT-4, Claude v2.1 and Mythomax do not give up-to-date information, which makes them unsuitable for the prompts shown above.
As Perplexity: Sonar 8x7B Online has an in-house search technology, it actually gives very detailed answers to short prompts, as expected even for a regular search engine.
Nevertheless, it might not always be a good idea to provide very large prompts to Perplexity: Sonar 8x7B Online. Although we have shown in a prompt above that a very detailed answer came out from a large prompt, sometimes the context is not taken completely into account, resulting in relatively incomplete answers, which is not an issue for GPT-4. Our recommendation is to try to use not extremely large prompts unless necessary, and carefully check if the context given in the prompt is really relevant in the answer.
Finally, PPLX 70B Online has a very poor performance for simulating conversations and roleplaying, which is not an issue for Mythomax L2 13B 8K.
TL;DR
Perplexity: Sonar 8x7B Online is a propiertary large language model (LLM) developed by Perplexity AI, which provides real-time access to the internet and up-to-date information. The model is built on top of the open-sourced Llama-2 70B model, with adjustments to access and utilize live internet data.
Specialities
Up-to-date information, detailed answers to short prompts.
Limitations
Not always suitable for very large contexts.
Chat examples:
– Up-to-date calls
– Consultancy online
Prompt templates examples:
– Business Consultant to Start Your Company
– Chasing Calls from Accelerators and VC
