Run Gemma on Reachy Mini, an open source robot


๐Ÿ“ ์š”์•ฝ

Gemma ๋ชจ๋ธ์€ ๋กœ๋ณดํ‹ฑ์Šค, IoT ์žฅ์น˜ ๋“ฑ์— ํ™œ์šฉ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด ๋ชจ๋ธ์€ ๋…ธํŠธ๋ถ, ๋ฐ์Šคํฌํ†ฑ๋ฟ๋งŒ ์•„๋‹ˆ๋ผ Raspberry Pi, Jetson Orin Nanos ๊ฐ™์€ ํ•˜๋“œ์›จ์–ด์—์„œ๋„ ์‹คํ–‰ ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค. Gemma ๋ชจ๋ธ์„ ํƒ‘์žฌํ•œ Reachy Mini ๋กœ๋ด‡์€ ์‹œ๊ฐ, ์ฒญ๊ฐ, ๊ฐ์ • ํ‘œํ˜„, ์›€์ง์ž„, ๋Œ€ํ™”๊ฐ€ ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค. ๋กœ์ปฌ์—์„œ ๋ชจ๋ธ์„ ์‹คํ–‰ํ•˜๋ฉด ํ”„๋ผ์ด๋ฒ„์‹œ์™€ ์†๋„๋ฅผ ํ–ฅ์ƒ์‹œํ‚ฌ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋กœ๋ณดํ‹ฑ์Šค ๋ถ„์•ผ์—์„œ Gemma ๋ชจ๋ธ์€ ๋น ๋ฅธ ๋ฐ˜์‘ ์†๋„๋ฅผ ์ œ๊ณตํ•˜์—ฌ ์‹ค์‹œ๊ฐ„ ์ƒํ˜ธ์ž‘์šฉ์— ์œ ๋ฆฌํ•ฉ๋‹ˆ๋‹ค. Gemma ๋ชจ๋ธ์€ Reachy ๋กœ๋ด‡์„ ํ†ตํ•ด ์กฐ๋ช…, ์˜จ๋„ ์กฐ์ ˆ ์žฅ์น˜ ์ œ์–ด, ๋ฉ”์‹œ์ง€ ์ „์†ก ๋“ฑ ๋‹ค์–‘ํ•œ ์•ก์…˜ ์ˆ˜ํ–‰์ด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค. ์Šค๋งˆํŠธ ์žฅ์น˜ ๋ฐ API์™€ ์—ฐ๋™ํ•˜์—ฌ ์บ˜๋ฆฐ๋” ๊ด€๋ฆฌ, ์‹ค์‹œ๊ฐ„ ๋ฐ์ดํ„ฐ ์กฐํšŒ, ์ž๋™ํ™” ์‹œ์Šคํ…œ ์ œ์–ด ๋“ฑ ๊ด‘๋ฒ”์œ„ํ•œ ํ™œ์šฉ์ด ๊ธฐ๋Œ€๋ฉ๋‹ˆ๋‹ค. Gemma ๋ชจ๋ธ์€ ์˜คํ”„๋ผ์ธ ํ™˜๊ฒฝ์—์„œ๋„ ์ž‘๋™ํ•˜๋Š” ๊ฐœ์ธ ๋น„์„œ ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. Gemma ๋ชจ๋ธ์„ ๋กœ๋ด‡์ด๋‚˜ IoT ์žฅ์น˜์— ์ ์šฉํ•˜๋Š” ๋‹ค์–‘ํ•œ ์•„์ด๋””์–ด๋ฅผ ํ™˜์˜ํ•ฉ๋‹ˆ๋‹ค. Gemma ๋ชจ๋ธ์€ ํ”„๋ผ์ด๋ฒ„์‹œ, ์†๋„ ํ–ฅ์ƒ, ํ™ˆ ์ž๋™ํ™”, ํ™˜๊ฒฝ ๋ชจ๋‹ˆํ„ฐ๋ง ๋“ฑ์— ์œ ์šฉํ•˜๊ฒŒ ์‚ฌ์šฉ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.


์›๋ณธ ์˜์ƒ: https://www.youtube.com/watch?v=KPx3nRwbldE

๋Œ“๊ธ€

์ด ๋ธ”๋กœ๊ทธ์˜ ์ธ๊ธฐ ๊ฒŒ์‹œ๋ฌผ

LeRobot v0.4.0: Supercharging OSS Robot Learning

SmolVLA: Efficient Vision-Language-Action Model trained on Lerobot Community Data

LeRobot goes to driving school: World’s largest open-source self-driving dataset