Run DeepSeek models on your own machine and interact with them using MATLAB

Generative AI
Suivre


Run DeepSeek models on your own machine and interact with them using MATLAB

Mike Croucher le 4 Fév 2025 à 14:27
Dernière activité Réponse par Mike Croucher le 4 Fév 2025 à 17:35

You've probably heard about the DeepSeek AI models by now. Did you know you can run them on your own machine (assuming its powerful enough) and interact with them on MATLAB?
In my latest blog post, I install and run one of the smaller models and start playing with it using MATLAB.
How to run local DeepSeek models and use them with MATLAB » The MATLAB Blog - MATLAB & Simulink
Larger models wouldn't be any different to use assuming you have a big enough machine...and for the largest models you'll need a HUGE machine!
Even tiny models, like the 1.5 billion parameter one I demonstrate in the blog post, can be used to demonstrate and teach things about LLM-based technologies.
Have a play. Let me know what you think.

2 commentaires

Connectez-vous pour participer
David
David le 4 Fév 2025 à 17:21
For comparison, I can run the 14b parameter distilled model just fine on my M1 Mac with 16 gigs of RAM.
Mike Croucher
Mike Croucher le 4 Fév 2025 à 17:35
Nice! I'll try that next
Mike Croucher

Mike Croucher

I write The MATLAB Blog at MathWorks and specialize in High Performance Computing, Research Software Engineering and Machine Learning. You can also follow me at BlueSky https://bsky.app/profile/walkingrandomly.bsky.social
26
Publications
226
Répondres
40
Abonnés
Suivre
Voir le profil

Publications de cet auteur

Afficher tout

Tags

Aucun tag saisi pour le moment.

Go to top of page