Many homes have security cameras these days, keeping a quiet eye on the driveway, the terrace, or the garden gates. Here at Villa La Treille Muscate, we realized those standard consumer cameras aren't just watching—they are listening, too.
Instead of buying expensive, specialized ecological microphones, we decided to tap into the live audio feeds (the RTSP streams) of the security cameras we already had mounted around the property (inside and outside we have over a dozen, like many people do). The microphones on these everyday cameras are surprisingly sensitive, capable of picking up everything from the rustle of leaves to a bird calling high up in the olive trees.
The Brain in the House
Those audio streams are sent securely over our local Wi-Fi network to a Mac Mini and to a VM running debian linux (my flavour of linux since the late 90's) on a Synology NAS, tucked away quietly inside the house and working together to get this magic done. They run all day and all night, acting as the brain of the operation.
On that Mac Mini, we run an advanced Artificial Intelligence model designed specifically for audio analysis. Mac Minis with their massive 'unified memory' are excellent at the task, barely consuming any CPU and barely costing me any electricity. Every second of the day and night, the AI listens to the ambient noise of the garden. It automatically filters out the wind, passing cars, and background hum, isolating the distinct acoustic signatures of bird calls.
Matching the Melody
When the AI isolates a chirp, a hoot, or a song, it compares that brief audio clip against a massive, scientific library of known bird vocalizations. If it finds a match with a high degree of confidence, it logs it: noting the species, the exact time, and how sure it is about the identification.
Finally, a small script on the VM (on the Synology) runs every few minutes to bundle up those recent discoveries and securely push them to this website over SSH, so you can see exactly who is visiting the garden right now.
A Deeper Dive at Home
While this public website just shows a glimpse of the latest visitors, the dashboard on our private home intranet holds a wealth of detailed statistics. Over time, the AI builds a comprehensive profile of the garden's ecosystem, revealing seasonal rhythms and hidden nighttime activity that we would never have noticed otherwise. It also allows us to listen to these recordings and find out when we have our morning coffee, who has visited our garden overnight! Sometimes, there's massive surprises. If it's a really rare bird, I get a 'Pushover' notification on my phone... What can I say? I'm a nerd!
It’s a wonderful way to repurpose everyday technology to build a deeper connection with the natural world around us. (And importantly, all the audio processing happens locally on our own hardware—nothing is ever recorded or sent to the cloud!)
If you’re a fellow tinkerer, a software developer, or just curious about the setup and would like to talk about it, feel free to drop me a line! Trust me, if I can do it, you can do it.