esp32-eye 是一套開源飲水監測系統,使用 MiniCPM-V 4.7、兩塊 ESP32-S3 與 MacBook,辨識個別貓咪並記錄每日飲水事件。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
🐱 Who’s been drinking from the water bowl? MiniCPM-V helps keep track.
Our ambassador @emwstudio built esp32-eye, an open-source monitor that recognizes individual cats and logs their daily drinking events, using MiniCPM-V 4.7, two ESP32-S3 boards, and a MacBook. 💧
From camera feed to daily counts, here’s how it works:
📷 Capture: An ESP32-S3 camera streams video from beside the water bowl to the MacBook.
⚡ Detect: MiniCPM-V 4.7 1B runs locally on the MacBook to check whether a cat is in view, filtering frames before calling the larger model.
🔍 Identify: MiniCPM-V 4.7 35B-A3B checks the scene and compares reference photos to identify the cat.
📊 Track: A separate ESP32-S3 AMOLED display shows live video and each cat’s daily count. The system also saves event clips with audio.
🐾 In a home setup with four cats, @emwstudio reports 89 manually checked drinking events over three days, with all cat identities correctly recognized.
A practical example of complementary models at work: an intelligent model handles frequent detection, while a larger model handles identity confirmation.
We love seeing our community turn MiniCPM’s visual understanding into creative tools for everyday life. What would you build? 💙
🎬 Watch @emwstudio’s demo on Instagram:
https://t.co/1OZwOr3RxN
🛠️ Explore @emwstudio’s project:
https://t.co/5GASJzefLw
🚀 Build with MiniCPM-V:
GitHub: https://t.co/msjm2QlrvX
🤗 Hugging Face: https://t.co/crJ549ztb2