That's full quantization. If you run Q4 or Q8 you can run this on <$10,000 equipment.
deadbabe 16 minutes ago [-]
No point in running anything but full quantization.
cma 1 hours ago [-]
And if you add in heavy sparsification it should fit and run on a raspberry pi.
rvz 53 minutes ago [-]
So in around 6 months, we will see that the person who bought this H200 in the listing just got scammed for $250k and will realize that you just needed specific quantizations to the model and a few optimizations to run locally.
Unless they want to train their own model, buying this for inference for $250k is unnecessary and still isn't enough for a fully production deployment.
vFunct 50 minutes ago [-]
It's already sparsified from the 150T parameter model..
swyx 5 hours ago [-]
1. this is apparently MiniMax's "launch week" - they did M1 on Monday and Hailuo 2 on Tuesday (https://news.smol.ai/issues/25-06-16-chinese-models). remains to be seen if they can keep up the pace of model releases for the rest of this week - these 2 were big ones, they aren't yet known for much else beyond llm and video models. just watch https://x.com/MiniMax__AI for announcements.
2. minimax m1's tech report is worthwhile: https://github.com/MiniMax-AI/MiniMax-M1/blob/main/MiniMax_M... while they may not be the SOTA open weights model, they do make some very big/notable claims on lightning attention and their GRPO variant (CISPO).
(im unaffiliated, just sharing what ive learned so far since no comments have been made here yet
vintermann 4 hours ago [-]
"We publicly release MiniMax-M1 at this https url" in the arxiv paper, and it isn't a link to an empty repo!
I like these people already.
npteljes 4 hours ago [-]
This is stated nowhere on the official pages, but it's a Chinese company.
3. It's useful for people who may be interested in applying for jobs
spinningarrow 2 hours ago [-]
> It's conventional to do so
Where do you see that? e.g. I just checked https://openai.com/about/ and it doesn't say where they are based. I have no associations either way, but I usually have to work hard to find out where startups are based.
I can't say I remember any model/weights release including the nation where the authors happen to live or where the company is registered. Usually they include some details about what languages they've included to train on, and disclose some of their relationships, which you could use for inferring that from.
But is it really a convention to include the nation the company happen to be registered in, or where the authors live, in submitted papers? I think that'd stick out more to me, than a paper missing such a detail.
noelwelsh 2 hours ago [-]
OP said "official pages", which I took to mean the company website: https://www.minimax.io/ not the repo or the paper.
diggan 2 hours ago [-]
Ok, lets change the argument to "It's conventional for companies to publish what country they're located in on their project's page", which companies are doing this? Not even OpenAI or Anthropic are doing this as far as I can tell.
noelwelsh 2 hours ago [-]
If you mean a Github page, like text generated from the `README.md`, then I do not expect any mention of country there.
diggan 46 minutes ago [-]
> If you mean a Github page
I'm trying to figure out what you mean here. Where do you expect the country to be mentioned?
iLoveOncall 2 hours ago [-]
1. No it's not. Top GitHub repository from Google as an example: https://github.com/google/material-design-icons I think you'd actually be hard pressed to find a single repository where the company that owns it lists where they are registered.
2. This is a requirement for companies registered in the UK. You should also read your own link, it doesn't say anything about the company's presence on 3rd party websites.
3. This is such a remote reason it's laughable, there are plenty more things that are more relevant to potential job applications, such as whether they are hiring at all or not.
You just want them to mention it because it's a Chinese company. If they were American, Mexican, German or Zimbabwean you wouldn't give the slightest fuck.
npteljes 2 hours ago [-]
Your link's parent page (https://github.com/google) states that they are in the United States of America, on the top, so it's not a good example.
I don't know about your OP, but even as a layperson, I personally like to check where my things come from. And yes, I am mostly curious about which wide geopolitical region the thing is from.
In case of IT projects, it matters when I want to include them in a project.
Also, thanks for putting words in my mouth. If they were Mexican or Zimbabwean I would find it very interesting to see a roughly SOtA model coming from that country.
npteljes 2 hours ago [-]
Forget the project page, I couldn't find definitive information on any of the official pages.
They state HQ in Singapore on LinkedIn, and San Francisco elsewhere. Compared to this, it's outright disingenuous that they don't mention that they are a Chinese company.
As a layman, I'm mostly indifferent to this information.
If I were a project manager, this would be vital information. And the people running projects know this. So it begs the question: why not disclose, and why obscure it?
markkitti 3 hours ago [-]
Please come up with better names for these models. This sounds like the processor in my Mac Studio.
They named themselves after a classic ai algorithm.
JoeDaDude 1 hours ago [-]
As best I can tell from a gloss-over read, it doesn't use anything like the Minimax algorithm. Astute readers are aware that one of the first applications of Minimax was in an AI chess program designed by Claude Shannon.
Your Mac is made by 'Apple' and literally named after an apple cultivar
diggan 2 hours ago [-]
Also sounds like my long lost dog whose name was Max but he was tiny. Absolutely horrible name, borderline criminal I say.
noelwelsh 4 hours ago [-]
A few thoughts:
* A Singapore based company, according to LinkedIn. There doesn't seem to be much of a barrier to entry to building a very good LLM.
* Open weight models + the development of Strix Halo / Ryzen AI Max makes me optimistic that running great LLMs locally will be relatively cheap in a few years.
freeqaz 7 minutes ago [-]
In a linked Twitter post[0], they trained this for $500k-ish. I wonder how?
> RL at unmatched efficiency: trained with just $534,700
It seems more and more like an inevitability we will run models locally. Exciting and concerning implications.
If anyone has any suggestions of people thinking about this space they respect, I'd love to listen to more ideas and thoughts on the developments.
noelwelsh 3 hours ago [-]
I think the main limitation, right now, is hardware. For GPUs the main limit is the VRAM available on consumer models. CPUs have plenty of memory but don't have the bandwidth or vector compute power for LLMs. This is why I think the Strix Halo is so exciting: it has bandwidth + compute power plus a lot of memory. It's not quite where it needs to be to replace a dedicated GPU, but in a few iterations it could be.
I'm interested in other opinions. I'm no expert on this stuff.
jb1991 3 hours ago [-]
How does the shared memory model for GPUs on Apple Silicon factor into this? These are technically consumer grade and not very expensive, but they can offer a huge amount of memory since all the memory is shared between CPU and GPU, even a midtier machine can easily have 100 GB of GPU memory.
noelwelsh 3 hours ago [-]
If you squint the M4 is the same as the Strix Halo. The M4 has roughly
* double the bandwidth;
* half the compute; and
* double the price for comparable memory (128GB)
compared to the Strix Halo.
I'm more interested in the AMD chips because of cost plus, while I have an Apple laptop, I do most of my work on a Linux desktop. So a killer AMD chip works better for me. If you don't mind paying the Apple tax then a Mac is a viable option. I'm not sure on the software side of LLMs on Apple Silicon but I cannot imagine it's unusable.
Apple has machines with 2x and about 3x the Strix Halo bandwidth by doubling up the memory buses. These get expensive though.
pantulis 3 hours ago [-]
Honest question: what is the concerning aspect to it?
psychoslave 2 hours ago [-]
I don't know, what's worst with people running LLM locally compared to running any software locally?
There is nothing fundamentally new in having freedom in edge of societies. Yes it can lead to horrible situation, like someone kill neighbors, using the single handable bright new tool available to all. But that's far less of a concern than having the powerful new tool staying in full concentrated control of the greediest humans out there, who will gladly escalate any hindrance to genocide whenever something doesn't fit their perspective.
rfoo 4 hours ago [-]
> A Singapore based company, according to LinkedIn
Nah, this is a Shanghai-based company.
diggan 2 hours ago [-]
No, they're based in Ireland.
Are we just saying stuff now? At least provide some sort of source if you're gonna say someone is wrong.
Deathmax 2 hours ago [-]
https://www.minimaxi.com is their website for the Chinese parent company 上海稀宇科技有限公司, https://minimax.io is their international website for the Singapore based company Nanonoble Pte Ltd that handles operations outside of China.
Wikipedia in itself is no source, and after reading parents message I went there to check to and surprise surprise, neither of the statements have sources attached to it. None of the linked articles have any information about where their headquarters is either.
If someone knows of a trustworthy article that states it outright, please feel free to share.
noelwelsh 2 hours ago [-]
I'm the OP who claimed it was Singaporean, after checking LinkedIn. I then found the Wikipedia page, which I posted above. Amongst the comments here there is also a link to a Bloomberg article about a potential IPO. I don't have a dog in the race. Just passing on what I found.
ulfw 1 hours ago [-]
They are a Chinese company based out of the city of Shanghai, not Singapore.
They're also planning to IPO at HKEX in Hong Kong soon
1. https://github.com/MiniMax-AI/MiniMax-M1/issues/2#issuecomme...
2. https://www.ebay.com/itm/335830302628
Unless they want to train their own model, buying this for inference for $250k is unnecessary and still isn't enough for a fully production deployment.
2. minimax m1's tech report is worthwhile: https://github.com/MiniMax-AI/MiniMax-M1/blob/main/MiniMax_M... while they may not be the SOTA open weights model, they do make some very big/notable claims on lightning attention and their GRPO variant (CISPO).
(im unaffiliated, just sharing what ive learned so far since no comments have been made here yet
I like these people already.
https://en.wikipedia.org/wiki/MiniMax_(company)
2. It's a legal requirement in some jurisdictions (e.g. https://www.gov.uk/running-a-limited-company/signs-stationer...)
3. It's useful for people who may be interested in applying for jobs
Where do you see that? e.g. I just checked https://openai.com/about/ and it doesn't say where they are based. I have no associations either way, but I usually have to work hard to find out where startups are based.
I can't say I remember any model/weights release including the nation where the authors happen to live or where the company is registered. Usually they include some details about what languages they've included to train on, and disclose some of their relationships, which you could use for inferring that from.
But is it really a convention to include the nation the company happen to be registered in, or where the authors live, in submitted papers? I think that'd stick out more to me, than a paper missing such a detail.
I'm trying to figure out what you mean here. Where do you expect the country to be mentioned?
2. This is a requirement for companies registered in the UK. You should also read your own link, it doesn't say anything about the company's presence on 3rd party websites.
3. This is such a remote reason it's laughable, there are plenty more things that are more relevant to potential job applications, such as whether they are hiring at all or not.
You just want them to mention it because it's a Chinese company. If they were American, Mexican, German or Zimbabwean you wouldn't give the slightest fuck.
I don't know about your OP, but even as a layperson, I personally like to check where my things come from. And yes, I am mostly curious about which wide geopolitical region the thing is from.
In case of IT projects, it matters when I want to include them in a project.
Also, thanks for putting words in my mouth. If they were Mexican or Zimbabwean I would find it very interesting to see a roughly SOtA model coming from that country.
They state HQ in Singapore on LinkedIn, and San Francisco elsewhere. Compared to this, it's outright disingenuous that they don't mention that they are a Chinese company.
As a layman, I'm mostly indifferent to this information.
If I were a project manager, this would be vital information. And the people running projects know this. So it begs the question: why not disclose, and why obscure it?
They named themselves after a classic ai algorithm.
https://en.wikipedia.org/wiki/Claude_Shannon#Shannon's_compu...
* A Singapore based company, according to LinkedIn. There doesn't seem to be much of a barrier to entry to building a very good LLM.
* Open weight models + the development of Strix Halo / Ryzen AI Max makes me optimistic that running great LLMs locally will be relatively cheap in a few years.
> RL at unmatched efficiency: trained with just $534,700
0: https://x.com/MiniMax__AI/status/1934637031193514237
If anyone has any suggestions of people thinking about this space they respect, I'd love to listen to more ideas and thoughts on the developments.
I'm interested in other opinions. I'm no expert on this stuff.
* double the bandwidth;
* half the compute; and
* double the price for comparable memory (128GB)
compared to the Strix Halo.
I'm more interested in the AMD chips because of cost plus, while I have an Apple laptop, I do most of my work on a Linux desktop. So a killer AMD chip works better for me. If you don't mind paying the Apple tax then a Mac is a viable option. I'm not sure on the software side of LLMs on Apple Silicon but I cannot imagine it's unusable.
An example of desktop with the Strix Halo is the Framework desktop (AI Max+ 395 is the marketing name for the Strix Halo chip with the most juice): https://frame.work/gb/en/products/desktop-diy-amd-aimax300/c...
There is nothing fundamentally new in having freedom in edge of societies. Yes it can lead to horrible situation, like someone kill neighbors, using the single handable bright new tool available to all. But that's far less of a concern than having the powerful new tool staying in full concentrated control of the greediest humans out there, who will gladly escalate any hindrance to genocide whenever something doesn't fit their perspective.
Nah, this is a Shanghai-based company.
Are we just saying stuff now? At least provide some sort of source if you're gonna say someone is wrong.
If someone knows of a trustworthy article that states it outright, please feel free to share.
They're also planning to IPO at HKEX in Hong Kong soon
https://www.scmp.com/tech/tech-trends/article/3314819/deepse...
https://www.bloomberg.com/news/articles/2025-06-18/alibaba-b...