Umsizi we-AI one-Raspberry Pi: Amaphrojekthi womhlaba wangempela, ihadiwe, kanye nomhlahlandlela osebenzayo

  • I-Raspberry Pi 4/5 inika amandla abasizi bezwi nolimi nge-VOSK, ukuhleba okusheshayo, nama-LLM angasindi.
  • I-AI Kit ene-Hailo-8L inikeza 13 TOPS futhi ihlanganisa ku-Raspberry Pi OS (libcamera/picamera2).
  • I-Hybrid Architectures: okulotshiweyo kwendawo kanye ne-LLM ekude nge-Ollama/Meshnet ukuze uthole ibhalansi yobumfihlo bokusebenza.

Umsizi we-AI nge-Raspberry Pi

Uma ucabanga ukusetha i-a Umsizi we-AI nge-Raspberry PiUsendaweni efanele: namuhla, inhlanganisela yezwi, umbono, namamodeli olimi isivele iyasebenza kulawa ma-SBC amancane, kokubili nge-Raspberry Pi 4 kanye ne-Raspberry Pi 5 enamandla kakhulu. Kunamaphrojekthi angempela abonisa lokhu, futhi kukhona nezinsiza ezisemthethweni eziletha ukusheshisa kwe-AI ebhodini ukuze kuqhutshwe igxathu elingaphezulu.

Kulesi sihloko uzothola ukubuka konke okuphelele: kusuka kumsizi wasekhaya owenziwe wasebenza ngezwi okusekelwe ku-Pi 4 namathuluzi afana U-VOSK no-Ollama...kufika ku-Pi 5 esebenzisa igama, okulotshiweyo, kanye nencazelo yendawo enamamodeli ahlangene afana ne-Qwen3:1.7bo ne-Gemma3:1b. Uzobona nokuthi i-AI Kit ene-Hailo-8L NPU ingena kanjani ku-Pi 5, imitapo yolwazi ezosetshenziselwa ukuqashelwa kanye ne-TTS, nokuthi kungani kubalulekile ukubeka ezokuphepha kuqala ekhaya nasemsebenzini.

Kungani wakhela umsizi we-AI nge-Raspberry Pi

ulwazi mayelana ne-automation yasekhaya
I-athikili ehlobene:
Ulwazi mayelana ne-automation yasekhaya: umhlahlandlela osebenzayo, ukusetshenziswa kanye nezitayela

Umsizi ohlakaniphile ku-Raspberry Pi ikuvumela ukuthi ulawule amadivayisi, uphendule imibuzo, futhi wenze okuzenzakalelayo imizila ngenani eliphansi futhi usebenzise amandla amancane; ngamanye amazwi, inkundla ekahle funda, prototype, futhi phaka izwi nolimi imisebenzi ngaphandle njalo kuye ngokuthi ifu.

Nge-Raspberry Pi ungahlanganisa imibhobho, amakhamera, nezikrini ezincane, kanye nohlelo ku-Python, Java, noma C++; lokhu kuvula umnyango wamaphrojekthi kusukela kuphaneli yesimo eyenziwe yasebenza ngezwi ukuya ohlelweni lokulawula ukufinyelela olunokubonwa kobuso, kanye ne-bot yasekhaya lalela, ahumushe futhi enze ngokwemiyalo yakho.

I-Raspberry Pi 4 vs Raspberry Pi 5: amandla namathuba

I-Raspberry Pi 4 ibonise ukuthi umsizi wezwi wendawo ungenzeka uma ukhetha isitaki esifanele; kodwa-ke, i-Raspberry Pi 5 ayigcini ngokusheshisa i-CPU ne-GPU, kodwa futhi yengeza ukuxhumana kwe-PCIe kwezinsiza ezisebenza kahle futhi ithuthukisa amachweba kanye nomkhawulokudonsa, ngakho-ke. isipiliyoni jikelele siba nekhono ngokwengeziwe.

Phakathi kokucaciswa kwe-Pi 5, izici zayo ezivelele zifaka iphrosesa ye-ARM Cortex-A76 efika ku-2,4 GHz, efika ku-8 GB we-LPDDR4X RAM, i-Wi-Fi 5, i-Bluetooth 5.0/BLE, kanye namachweba ama-micro-HDMI amabili aphuma ku-4K ku-60 Hz. Kuhlanganiswe nesethi eqinile yezinzwa, lokhu kuvumela umsizi ukuthi aphathe imisebenzi efanayo ngaphandle komthungo futhi anakekele ukubambezeleka okuphansi ekusebenzelaneni ngezwi.

I-ASRAI: iphrojekthi yangempela ene-Pi 4 egxile kubumfihlo nokulawula

Umenzi ohlakaniphile udale i-ASRAI, umsizi owenza izwi lasebenza owakhiwe ku-Raspberry Pi 4 Model B ngesibonisi esingu-3,5-intshi se-GPIO kanye nekhamera ye-Sony PlayStation Eye. Igugu langempela yi-PlayStation Eye: ihlanganisa uhlu lwamakrofoni amane olungavaleka kalula ku-Pi futhi, emakethe yamasekeni, lungatholakala ngokungena lutho, okwenza kube ukuthengiselana kwangempela. isivumelwano sokuthwebula umsindo ngokwakhiwa kwemishayo eyisisekelo.

Kuphrojekthi, i-Pi 4 isebenzisa i-VOSK endaweni ukuze ibonwe inkulumo ungaxhunyiwe ku-inthanethi futhi ixhuma ngenethiwekhi ku-LLM esingathwa ku-PC yombhali ngephoyinti le-API elihambisana ne-OpenAI ngo-Ollama. Ukwenza lolu xhumo lusebenze noma yikuphi, umdali unike amandla i-Meshnet ye-NordVPN, ngaleyo ndlela kuzuzwe i- isixhumanisi esiyimfihlo nesitholakala yonke indawo ngaphandle kokudalula izinsiza ku-inthanethi.

Umqondo uwukulanda ukuthwebula, ukuvusa izwi, nokulotshwa kwendawo ku-Pi nge I-VOSK, kuyilapho ukukhiqizwa kolimi kuphathwa imodeli enamandla kakhulu komunye umshini kusetshenziswa i-OpenAI-type API evezwe yiyo U-Ollama kanye nokubonga okufinyelelekayo ku-Meshnet; ngale ndlela, ukusebenza nobumfihlo kuyalingana.

Ngokuthinta "umuntu", iphrojekthi ihlanganisa izithombe zokulala noma zokulalela esikrinini esincane. Uma ungathanda ukuyiphindaphinda, umdali wabelana ngezisetshenziswa ezidingekayo, futhi kuyasiza ukuba... Iphrinta ye-3D ne-welder yokuhlanganisa nokulungiswa kohlu lwamakrofoni.

Isinyathelo saqokonyiswa abezindaba abakhethekile futhi sikhumbuza ezinye izindlela ezifana ne-Rhasspy kufilosofi yokuklama: ukuqashelwa kwendawo kanye nomculo we-modular. Kukhona nokushiwo ngabahlanganyeli abasondelene abaguqule i-Pi yabo yaba Umsizi we-AI futhi yahlaziya ukusebenza kwama-AI ahlukene ku-Raspberry Pi 5 ukuze iqondise labo abacabanga ukwenza ukugxuma kokukhiqiza.

Ikhithi ye-AI Esemthethweni ye-Raspberry Pi 5: Ithrekhi esheshayo eya ekusheshiseni

Uma ukhetha ukuyisa kuleveli elandelayo, i-AI Kit ye-Raspberry Pi 5 yengeza i-Hailo-8L NPU phezu kwe-M.2 2242 efakwe ngaphambili enamathiselwe ku-M.2 HAT+. Le nhlanganisela ihlinzeka ngama-TOPS afika kwangu-13 ukuze kucatshangwe kahle, ikhulule i-CPU emthwalweni omkhulu womsebenzi futhi ivumele umsizi ukuthi aqhube amamodeli ombono noma omsindo nge- ukubambezeleka okuphansi nokusetshenziswa.

Iphakethe liza liphelele: unhlokweni we-GPIO onamathelayo, ama-spacers, izikulufu, intambo yeribhoni eguquguqukayo yokuxhuma ibhodi le-AI ebhasini le-Pi 5's PCIe, kanye ne-heatsink efanelekile yokugcina amazinga okushisa elawulwa. Ukufakwa ngokomzimba kuqondile, bese isoftware isetshenziswa. apt ku-Raspberry Pi OS.

  • I-Hailo AI Module ene-Hailo‑8L NPU
  • I-Raspberry Pi M.2 HAT+ ye-Raspberry Pi 5
  • Iphedi eshisayo efakwe ngaphambili phakathi kwemojuli ne-HAT+
  • Ikhithi yokukhweza enama-spacers nezikulufu
  • Isixhumi se-GPIO esitakisekayo esingu-16mm nentambo ye-PCIe eyisicaba

Ukuhlanganiswa kwedivayisi ye-Hailo endaweni ye-Raspberry Pi OS sekuvuthiwe: kusebenza nayo i-libcamera, izinhlelo zokusebenza ze-rpicam ne-picamera2 kanye ne-software ecosystem (i-Hailo, i-HailoRT, nezishayeli ze-HailoTappas) zifakwa ngokuqondile ngomphathi wephakheji. Ngale ndlela, isisekelo somsizi wokubona wekhompyutha (isb., ukutholwa kobuso noma ukuthinta) silungile. ukungqubuzana okuncane.

Sebenzisa izimo: kusuka kulawulo lwasekhaya ukuya kumsizi wengxoxo

Nge-Pi 5 kanye ne-AI Kit ungakwazi ukusetha noma yini kusukela ohlelweni lokulawula ukufinyelela ukuqashelwa kobuso kuya ku- umsizi wasekhaya oxoxayo “I-handsfree.” Irobhothi elilula elinokuzulazula okuyisisekelo elithola imiyalo yezwi futhi liphendule ngayo inhlanganisela yenkulumo ngombhobho.

Uma ungafuni ama-accelerator, indlela eyingxube efana ne-ASRAI (ukucubungula inkulumo yendawo kanye ne-LLM ekude) noma indlela yendawo ephelele enamamodeli akamuva ahlangene nayo iyasebenza. Ukhiye uwukushuna kahle usayizi wemodeli, ukulinganisa, kanye nepayipi lomsindo ukuze uqinisekise umuzwa ongenazihibe. ishesha futhi izinzile kuhadiwe etholakalayo.

Isofthiwe engukhiye yezwi nolimi ku-Raspberry Pi

Ukuze uthole ukunakwa kwenkulumo ungaxhunyiwe ku-inthanethi, i-VOSK iwukubheja okuphephile ku-Raspberry Pi. Ezinye izindlela ezifana ne-PocketSphinx nazo ziwusizo, futhi uma ukhetha izinsizakalo zamafu, kukhona ukuhlanganiswa nezinjini ezifana ne-Google Speech Recognition; nokho, amaphrojekthi amaningi abeka phambili ubumfihlo kanye nokubambezeleka okuphansingakho-ke okulotshiweyo kwendawo kuyazuza.

Ngokuhlanganiswa kwenkulumo yendawo, i-pyttsx3 inikeza i-TTS eyisisekelo ngaphandle kokuncika kwangaphandle. Ngokuphathelene nengxenye ye-LLM, i-Ollama yenza amamodeli asetshenziswayo abe lula ngesiphetho esithi "OpenAI ehambisanayo", okwenza kube lula ukuxhuma imibhalo yangokwezifiso noma amaklayenti akhona. Ngale ndlela, i-Pi yakho ingakwazi ukuhlela ipayipi futhi idlulisele ukukhiqiza [kuhlelo lokusebenza/ithuluzi elithile - kudingeka umongo]. iqembu elinamandla kakhulu.

I-ejenti encane engu-100% ye-Pi 5: igama lokuvuka, okulotshiweyo, nencazelo yendawo

Umuntu oshisekayo ukhombisile ukuthi i-Raspberry Pi 5 ene-16 GB ye-RAM ingaqalisa umjikelezo wonke: icuphe ukutholwa kwegama nge-VOSK, ukuloba ngokuhleba okusheshayo, nokusikisela ngama-LLM ahlangene afana ne-Qwen3:1.7 nge-Gemma3:1b, konke endaweni. Kuyinselelo yokwenza kahle, kodwa ingenziwa; inqolobane nokuthunyelwe kwebhulogi okubhalwe phansi kuyinsiza enkulu. yami yokufunda ekulungiseni kahle nasekuphathweni kwezinsiza.

Isifundo esivela kulesi sibonelo sicacile: ngamamodeli akhethwe kahle, ukulinganisa, kanye nepayipi elilula, i-Pi 5 iphendula ngezikhathi ezifanele. Uma iphrojekthi idinga amandla okucubungula engeziwe, kuhlale kunenketho yokusebenzisa i-Hailo-8L ngemisebenzi yokuqonda (ukubona, umsindo) nokugcina i-LLM yendawo engasindi noma ukuthembela ku- Iseva ekude iyahambelana.

Ukuqalisa: isistimu yokusebenza, imitapo yolwazi, nesakhiwo sephrojekthi

Ukwandisa izinsiza, onjiniyela abaningi batusa i-Raspbian (Raspberry Pi OS) ekuhlukeni kwayo kwe-Lite, okunciphisa izinsizakalo kanye nokusetshenziswa kwememori eyisisekelo. Ukusuka lapho, faka inkulumo, i-TTS, nemitapo yolwazi ye-orchestration ozoyidinga; ngePython, kulula ukwakha i-prototype esebenzayo futhi eyingozi. amamojula ahlukaniswe kahle.

Iresiphi ye- ibhuthini Okujwayelekile kuhlanganisa:

  1. Faka i-Raspberry Pi OS Lite futhi usebenzise izibuyekezo zesistimu.
  2. Lungiselela umsindo (amakrofoni nesipikha), ikhamera uma kusebenza, futhi uhlole nge-arecord/aplay.
  3. Faka amaphakheji afana Ukuqashelwa Inkulumo (uma uzosebenzisa izinsiza zamafu) noma i-VOSK/PocketSphinx ngokungaxhunyiwe ku-inthanethi, kanye pyttsx3 kwe-TTS yendawo.
  4. Khetha ingemuva lakho le-LLM: okwasendaweni nge-Ollama namamodeli amancane, noma isilawuli kude esihambisanayo.
  5. Khoda iluphu eyinhloko ngePython: lalela, bhala, tolika (NLP) futhi wenze izenzo.

Kusendlalelo se-NLP, ungaqala ngezinhloso nemithetho elula, futhi ufake i-LLM njengoba uqhubeka. Ngokwenza umyalo, chaza ama-adaptha kudivayisi ngayinye noma isevisi (isibonelo, izibani, isilawuli sezulu, izikhumbuzi), ukuze umsizi agcine umgogodla ohlanzekile nonwebekayo.

Ukuxhumana kanye ne-orchestration: yonke into ihambisana nenethiwekhi enhle

I-Pi ihlanganisa i-Wi-Fi 5 ne-Bluetooth 5.0/BLE, ngakho ingakwazi ukuxhumana ngokungenantambo ngamalambu okukhanya, izipikha, nezinzwa. Uma izinsiza zangaphandle noma imishini eminingi ibandakanyeka, indwangu yenethiwekhi yangasese efana ne-NordVPN's Meshnet yenza lula ikhono le-Pi "lokubona" ​​iseva yemodeli engaphandle kwesayithi ngaphandle kokudalula izimbobo emhlabeni, ukugcina. ukulawula nokuvikeleka.

Uma uhlela ukusebenzisa iwizadi ezindaweni ezihlukene, cabangela iziqukathi zezingxenye ze-inference noma amapayipi e-multimedia. Isakhiwo esinamasevisi ahlukene (i-ASR, i-TTS, i-LLM, i-orchestrator) izokuvumela ukuthi ulinganise izingxenye futhi uhambise imithwalo yomsebenzi kwenye indawo. umthelela omncane kulo lonke uhlelo.

Ukuphepha: imikhuba ehamba phambili kanye nokuba sengozini okufanele kuqashwe

Umsizi uhlala elalele okumzungezile futhi exhumana namanye amadivayisi, ngakho ukuphepha kwe-inthanethi kubalulekile. Qala ngokugcina isistimu namalabhulali kusesikhathini samanje ukuze unciphise ukuxhashazwa okwaziwayo, futhi unike amandla ukubethela kukho konke ukuxhumana phakathi kwamadivayisi; ukuhlukanisa inethiwekhi ye-IoT kulo lonke ikhaya kuyisilinganiso esisodwa. ezishibhile futhi ngempumelelo.

Kufanelekile ukubuyekeza izeluleko mayelana ne-IoT ne-middleware, futhi uqaphele ubungozi bomphakathi obufana CVE‑2021‑22945 o CVE‑2021‑22946 Phakathi kwezinye izinto, zisebenza njengezikhumbuzo zokuhlola ukuncika futhi zisebenzise iziqephu ngokushesha. Umgomo uwukuba umsizi wakho abe usizo ngaphandle kokuba umthwalo. i-vector eyingozi.

Ukuhlanganiswa nekhamera kanye nombono wekhompyutha

Uma umsizi wakho ehlanganisa ikhamera, i-Pi 5 isebenza kahle nge-libcamera kanye nezinhlelo zokusebenza ze-rpicam; ngaphezu kwalokho, i-picamera2 isiza ukufinyelela okuhleliwe ekusakazweni kwevidiyo. Nge-Hailo-8L, imisebenzi efana nokutholwa kwento nokubonwa kobuso ithola isivinini nokusebenza kahle, okuvumela izimo ze ukulawula ukufinyelela noma i-automation yasekhaya ezwela umongo.

Indlela evamile iwukugcina umbono ku-Pi bese udlulisela ukutolika kwezinga eliphezulu ku-LLM (“uma ubona u-X, ngibuze ukuthi kufanele ngiwuvule yini umnyango”). Ngokwabelana ngemethadatha kuphela noma imiphumela, hhayi izithombe ezingavuthiwe, uthuthukisa ubumfihlo futhi unciphisa umkhawulokudonsa kunesidingo.

Izibonelo ezisebenzayo ezisebenzayo

- I-ASRAI ku-Pi 4: Imakrofoni ye-PlayStation Eye (imibhobho emi-4), isibonisi se-GPIO esingu-3,5-intshi, i-VOSK yendawo, i-LLM ekude nge-Ollama, nokuxhumana noma yikuphi nge-Meshnet. Kudinga ukuphrinta kwe-3D kanye ne-soldering encane, kodwa umphumela uwumsizi ishesha futhi ihlakaniphile.

– I-Pi 5 “konke-kukodwa”: igama lokuvusa nge-VOSK, okulotshiweyo ngokuhlebeza okusheshayo, nokusikisela kwendawo nge-Qwen3:1.7 ngo-Gemma3:1b. Okubalulekile ukwenza kahle kanye nokufaka usayizi wamamodeli ukuze kugcinwe ukubambezeleka okunengqondo; inqolobane ehlobene yi-a umhlahlandlela ophilayo ukulungisa iphrojekthi yakho.

- I-Pi 5 ene-AI Kit: ukuqashelwa kobuso ukuze uthole ukufinyelela, ukusabela kwesimo ngamamodeli ombono asheshisiwe kanye ne-LLM engasindi yengxoxo; I-Hailo, i-HailoRT kanye ne-HailoTappas abashayeli abafakekayo ngendlela efanele futhi ehambisana ne-libcamera ne-picamera2 ehlanganiswe kudivayisi ngokwayo. Okusajingijolo Pi OS.

Izinqubo ezinhle zokuthuthukiswa kanye nokugcinwa

Yakha ikhodi ibe amamojula: ukuthwebula umsindo, i-ASR, i-NLP, ukwenza, i-TTS, futhi, uma kusebenza, umbono. Engeza amalogi awusizo kanye nemodi yokususa iphutha ukuze ubone izingqinamba. Yenza ngokuzenzakalela ukuhlola okuyisisekelo (isb., izinhloso ezichazwe ngaphambilini) ukuze ugweme ukuhlehla uma wengeza izici ezintsha.

Ohlangothini lwe-hardware, naka amandla kanye nomoya omncane, ikakhulukazi uma wengeza i-NPU noma usebenza ngemithwalo esindayo. I-heatsink enhle kanye nokugeleza komoya okuhloniphekile kuvimbela i-thermal throttling futhi igcine umuzwa ozinzile. ingxoxo eqhubekayo.

Umphakathi nemithetho: Yabelana ngamaphrojekthi akho ngendlela efanele

Uma uzoshicilela umsizi wakho emiphakathini ye-Raspberry Pi, khumbula ukuthi ukuchaza ukuthi ukwenze kanjani kuyancomeka, hhayi nje ukukhombisa umphumela. Gwema ugaxekile nanoma yikuphi ukuziphatha okuhlukumezayo, futhi vele, azikho izenzo zikagesi ezingaphephile; ngaphandle kokufunda okwengeziwe, uzogcina a imvelo enempilo futhi iwusizo kuwo wonke umuntu.

Uma wabelana, bhala phansi izingxenyekazi zekhompuyutha yakho, izinyathelo ezibalulekile, okuncikile, izilungiselelo zomsindo, namamodeli asetshenzisiwe. Lokhu kusiza abanye baphindaphinde umsebenzi wakho futhi kunikeze impendulo ebalulekile; ekugcineni, lokhu kubambisana kusheshisa iphrojekthi yakho ngaphezu kwanoma iyiphi enye indlela. iqhinga elingalodwa.

Ongakulindela ekusebenzeni nokuthi unganquma kanjani ngesakhiwo sakho

– Uma ufuna ubumfihlo nokulawula okuphelele, khetha i-ASR yendawo kanye ne-TTS, kanye ne-LLM ehlangene ku-Pi 5 noma ehlinzekwa ngu-Ollama kunethiwekhi yakho yangasese ye-Meshnet. Ngale ndlela usebenza emaphethelweni futhi ugcine idatha yezwi ivikelekile. ngaphansi kophahla lwakho.

- Uma udinga izimpendulo ezicebile futhi ungakhathazeki ngokusebenzisa ifu, i-LLM ekude iqeda ibhodlela. I-Pi ibe isisebenza njengobuchopho obuhlelayo, ilawula izinzwa nama-actuator futhi ilawule iseshini yezwi nge ukubambezeleka okwamukelekayo.

- Uma umsizi wakho edinga "ukubona," i-AI Kit ene-Hailo-8L iyona ewinayo: 13 TOPS ukuze uthole umbono onqenqemeni, abashayeli nge-apt, kanye ne-ecosystem esekelwa i-Raspberry Pi OS. Hlanganisa lokhu ne-LLM yebanga eliphakathi ngaphandle kwe-Pi, futhi uzoba nesipiliyoni esihle. nxazonke futhi olinganiselayo.

– Uma ukhetha ukusetha kwendawo okugcwele, khetha amamodeli athuthukisiwe (Qwen3:1.7b, Gemma3:1b, noma okulinganayo) futhi unake umzila womsindo; ukusebenzisa i-Faster Whisper ekulotshweni kanye ne-VOSK yokucubungula amagama sekuvele kufakazelwe ukuthi a indlela esebenzayo ku-Pi 5 no-16 GB.

Ekugcineni, ukwakha umsizi we-AI nge-Raspberry Pi kuhlanganisa izingxenye ezitholakala kalula: i-hardware engabizi njenge-PlayStation Eye ehloselwe kabusha, isofthiwe efana ne-VOSK noma i-speed-whisper, i-OpenAI-compatible endpoints nge-Ollama, futhi, uma kudingeka, inzuzo eyengeziwe ye-Hailo-8L ku-Pi 5. Ngokunaka, ukubethela okuhlukile, ukucacisa amanethiwekhi, ukucacisa amanethiwekhi, ukucacisa amanethiwekhi suka kumbono uye kumsizi we-AI osebenza ngokugcwele. umsizi osebenzayo esebenza kahle egumbini lokuphumula noma ehhovisi.