Microsoft recently unveiled Phi-3-Mini, a compact yet powerful AI model that can operate locally on laptops and smartphones to perform activities like content creation, making it perfect for businesses with limited resources.
The company says that their AI model, which is Microsoft’s smallest to date, can outperform models twice its size because of a training process that stresses quality over quantity. The model was trained on a dataset significantly smaller than that of models like GPT-4.
Phi-3-Mini is one of his three smaller models Microsoft plans to release as big tech companies like Anthropic and Google aim to develop smaller, more targeted AI models. It’s just one thing. We’ll explain what users can expect from the smaller, cheaper model and how to test it for yourself.
Microsoft announces new AI model: Phi-3-Mini
For a long time, bigger meant better when it came to artificial intelligence. But while AI chatbots trained on large datasets like Gemini and ChatGPT have broader applications, many big tech companies are looking at Microsoft, which just announced its smallest AI model released. appears to be bucking this trend by releasing smaller, more targeted models.
It may sound like a house of brothers, but the Phi-3 Mini is one of three Compact Large Language (LLM) models built by Microsoft. Phi-3-Small and Phi-3 Medium are rumored to be coming in the future. market in the coming months. The company’s minimal model is trained on a much smaller dataset than other LLMs, measuring just 3.8 billion parameters compared to GPT-4’s 1.76 trillion parameters.
However, Microsoft says that even with minimal training data, this model performs much better than his December-released predecessor, Phi-2, up to 10 times the scale. claims to provide answers up to the model standard.
“The innovation lies entirely in our dataset for training, a scaled-up version of the one used for phi-2, composed of heavily filtered web data and synthetic data. The model is also further aligned for robustness, safety, and chat format.” – Microsoft
Phi-2-Mini’s success is largely due to its unique training method, which relies heavily on filtered web data and synthetic data, rather than real data generated by processes such as web crawling. Synthetic data is much cheaper to obtain, more diverse, and easier to refine than real-world data, making it the logical input for many small-scale AI models.
Are small and lightweight AI models the future?
Smaller models like the Phi-3 Mini require less processing power, so they typically have lower running costs than larger models and can be easily integrated into mobile phones and laptops. performance is excellent. This makes it ideal for businesses with small AI budgets that use chatbots for targeted use cases, such as content creation or solving math problems.
Microsoft is not alone in its focus on low-cost, targeted chatbots, as compact AI models have significant advantages over general-purpose models. Google recently released his two voice-focused chatbots, Gemma 2B and 7B, and Anthropic recently released Claude 3 Haiku, a bot whose main purpose is to summarize large research papers. has been released.
“If you have a very, very high stakes application, let’s say in a healthcare scenario, then I definitely think that you should go with the frontier model — the best, most capable, most reliable. For other uses, other factors matter more, including speed and cost. That’s where you want to go with Phi-3.” – Microsoft VP Sébastien Bubeck told Axios.
However, despite the recent rise in popularity of smaller models, Microsoft has not yet focused on larger models. According to the software maker, models like Phi-3 are not intended to replace larger models, but rather achieve goals that models like GPT-4 and Gemini cannot achieve, such as running locally on the device. It is said that it is aimed at fulfilling.
How do you get the Phi 3 mini AI from Microsoft?
Traditional chatbots aren’t going anywhere, but if you want to try Microsoft’s new micro chatbot, the Phi-3-Mini is It is open to the public.
Microsoft recently added Phi-3 to its cloud services platform, Azure Model Gallery. The bot is also available from open source modeling sites Hugging Face and Olloma. Phi-3-Small and Phi-3-Medium will also be available on these platforms in future releases.
If you don’t like Microsoft’s compact chatbot or want to compare it to its competitors, check out our guide to the best AI chatbots of 2024.
