et er net soon who knows?
The answer is obviously firewire.
Yep most definitely!
YES amazing! Should not be too hard.
Would you want it on like a adjusting arm or just a LED protruding from the laptop?
Hard mode, expansion card that has a seam down the middle and LED mounted on the exterior half. Enclosed the power cord with retract in the two halves of the shell, so you can pull it out of the side of the laptop for illumination, and retract for the OG form factor
This could be a candidate for expansion-cardification: just taking the electronics from this would probably fit in an over-length card, and anyone with more advanced PCB design skills would custom make one for the standalone chips they sell. USB AI accelerator
I love and hate being pounded with ideas! Thanks everyone
That AI accelerator is USB 2.0 so will not be hard!
Seems like the one they sell is USB 3 10Gbps, and the specsheet for the chip is either PCIe gen2 or USB2, but it mentions USB3 support if you contact them
Yep, itās much harder so I probably would stick to 2.0
I desperately want an AI accelerator, but Iād need it in all the time for my studies, so finding a way to fit the full dual-tpu module in something that can stay in my laptop everyday is paramount.
How much timeframe do you have as I can help you out. So you just need one of them?
Yeah, one of the m.2 (E-key) dual-tpu ones so that I can run my TF models reasonably well. Iām not starting school until May, and I probably wonāt take delivery of my Framework until December, so itās no rush, but Iām just trying to figure out how I could make it work. I have a 3D printer and reasonable CAD skills, but Iām using borrowed family computers in the meantime, booting off my (now external) m.2 boot drive when my family has a computer available, and I also have other responsibilites, so my time dedicated to these tasks is limited (hence why Iām starting now) so any help would be greatly appreciated.
@Josh_Cook The Coral TPUs run significantly slower over USB2 than over PCIe or USB3. The operation of the device relies heavily on streaming data in and out continuously, so moving to a 60MB/s half-duplex connection instead of 500MB/s (PCIe gen2 x1) full duplex is a pretty hefty loss. Running over USB3 apparently gets comparable performance to PCIe, but google says to talk to them when designing for it, so presumably itās a little awkward to get working. That would also explain why their own USB dongle is USB2.
@ERLindeman
I was looking into this a few days ago, and have a few suggestions:
If youāre willing to forgo wifi, or use an external wifi adapter, the internal wifi m.2 slot is E-key, and should ājust workā, giving you two TPUs right away.
You could also use the M.2 SSD slot and get one TPU, and boot off of an external storage module.
Alternatively, your most realistic āquickā solution would just be to buy one of the external USB2 modules.
Making the E-key card work in a module is a bit harder, because:
- Itās a pretty tight fit to actually pack in there, space-wise.
- Each TPU appears to require its own PCIe lane, meaning the thunderbolt lanes would have to be bifurcated.
If thunderbolt lane bifurcation is an option, then the real dream would be to use their little āAccelerator moduleā chips, four in one module, one for each 1x lane.
That would give you an obscene amount of TPUs (up to 12, assuming you still want one USB-C for power), comparable to that Asus card that LTT showed off, but for considerably less money.
This is something Iāve been looking into. I canāt give up wifi (college student, kinda needed), but Iāve been thinking of ditching my phone in favor of software on a Framework + an expansion module for 5G (and maybe BT and Wifi if I can manage it in an oversized āraised feetā expansion card).
TL;DR: Need both, but stalled deciding which is easier to put in a module.
Actually it looks like I was wrong. The little USB module they provide does work on USB3, so there shouldnāt be much of a performance penalty, if any, compared to PCIe for one TPU. The E-key card is still cheaper, though, and provides twice the performance.
Yeah the 2-TPU M.2 Card is the product Iāve settled on, now just to get it to fit along with wireless. Iām starting to think itāll have to go outside so that if I can manage to track down a workable 3-in-1 wireless card, I can use the existing antenna lines and only have to deal with the new 5G ones.