et er net soon who knows?
The answer is obviously firewire.
Yep most definitely!
After firewire gets sorted I have another project for you, Josh
YES amazing! Should not be too hard.
Would you want it on like a adjusting arm or just a LED protruding from the laptop?
Hard mode, expansion card that has a seam down the middle and LED mounted on the exterior half. Enclosed the power cord with retract in the two halves of the shell, so you can pull it out of the side of the laptop for illumination, and retract for the OG form factor
This could be a candidate for expansion-cardification: just taking the electronics from this would probably fit in an over-length card, and anyone with more advanced PCB design skills would custom make one for the standalone chips they sell. USB AI accelerator
I love and hate being pounded with ideas! Thanks everyone
That AI accelerator is USB 2.0 so will not be hard!
Seems like the one they sell is USB 3 10Gbps, and the specsheet for the chip is either PCIe gen2 or USB2, but it mentions USB3 support if you contact them
Yep, it’s much harder so I probably would stick to 2.0
I desperately want an AI accelerator, but I’d need it in all the time for my studies, so finding a way to fit the full dual-tpu module in something that can stay in my laptop everyday is paramount.
How much timeframe do you have as I can help you out. So you just need one of them?
Yeah, one of the m.2 (E-key) dual-tpu ones so that I can run my TF models reasonably well. I’m not starting school until May, and I probably won’t take delivery of my Framework until December, so it’s no rush, but I’m just trying to figure out how I could make it work. I have a 3D printer and reasonable CAD skills, but I’m using borrowed family computers in the meantime, booting off my (now external) m.2 boot drive when my family has a computer available, and I also have other responsibilites, so my time dedicated to these tasks is limited (hence why I’m starting now) so any help would be greatly appreciated.
@Josh_Cook The Coral TPUs run significantly slower over USB2 than over PCIe or USB3. The operation of the device relies heavily on streaming data in and out continuously, so moving to a 60MB/s half-duplex connection instead of 500MB/s (PCIe gen2 x1) full duplex is a pretty hefty loss. Running over USB3 apparently gets comparable performance to PCIe, but google says to talk to them when designing for it, so presumably it’s a little awkward to get working. That would also explain why their own USB dongle is USB2.
I was looking into this a few days ago, and have a few suggestions:
If you’re willing to forgo wifi, or use an external wifi adapter, the internal wifi m.2 slot is E-key, and should “just work”, giving you two TPUs right away.
You could also use the M.2 SSD slot and get one TPU, and boot off of an external storage module.
Alternatively, your most realistic “quick” solution would just be to buy one of the external USB2 modules.
Making the E-key card work in a module is a bit harder, because:
- It’s a pretty tight fit to actually pack in there, space-wise.
- Each TPU appears to require its own PCIe lane, meaning the thunderbolt lanes would have to be bifurcated.
If thunderbolt lane bifurcation is an option, then the real dream would be to use their little “Accelerator module” chips, four in one module, one for each 1x lane.
That would give you an obscene amount of TPUs (up to 12, assuming you still want one USB-C for power), comparable to that Asus card that LTT showed off, but for considerably less money.
This is something I’ve been looking into. I can’t give up wifi (college student, kinda needed), but I’ve been thinking of ditching my phone in favor of software on a Framework + an expansion module for 5G (and maybe BT and Wifi if I can manage it in an oversized “raised feet” expansion card).
TL;DR: Need both, but stalled deciding which is easier to put in a module.
Actually it looks like I was wrong. The little USB module they provide does work on USB3, so there shouldn’t be much of a performance penalty, if any, compared to PCIe for one TPU. The E-key card is still cheaper, though, and provides twice the performance.
Yeah the 2-TPU M.2 Card is the product I’ve settled on, now just to get it to fit along with wireless. I’m starting to think it’ll have to go outside so that if I can manage to track down a workable 3-in-1 wireless card, I can use the existing antenna lines and only have to deal with the new 5G ones.