Metal Toad Team Pi Cam

Freedom to Fumble: Learnings From Hackathon 2018

I spend all my time at work dealing with software. So going into this year’s hackathon, I was excited to get hands-on (and in over my head) with hardware. Having never even touched a Raspberry Pi before, I was in for an interesting couple of days!

Our team was just two people—me and Shivani Thakar. We set out for a small, achievable project broken down into phases.

  • Our first step was to set up a Raspberry Pi 3 Model B and Camera Module v2

  • Our second step would be to actually capture and store images with the camera

  • Our third step was to submit those images to Microsoft Cognitive Services for authentication, identification, and recognition

Day one

Day one was all about the hardware: mostly, trials and tribulations—heavy on the trials.

Hands-on work with the Raspberry Pi introduced us to a new world of troubleshooting beyond just code—wrestling with USB-C adapters, Wi-Fi connectivity, and voltages.

Multiple times we seemed to work our way to a dead end and would have to backtrack and redo our steps. We made a special effort to document all our troubleshooting and resources so that we were able to approach the next iteration on sure footing.

It was essential to have a teammate and to bounce ideas off each other. Shivani and I had not really had the opportunity to work together directly before. I wouldn’t have learned so much without her. And other Toads were excited to lend our team a hand, too. The freedom to try, fail, and try again—with a little help from our friends—created an ideal environment for innovation.

Day two

On day two, when we finally got our first photo processed, it was so exciting—all our work came together!

Exploring the potential of Microsoft Azure Cognitive Services was fascinating. Their offerings do the heavy lifting for the back end of machine learning, which opens up so many possibilities for applying image recognition to real-world scenarios.

 

We got plenty of accurate results, but also had a lot of laughs with the silly ones. My favorite machine-learning miss was seeing a picture of a Teenage Mutant Ninja Turtle figurine identified as “a woman standing in front of a mirror posing for the camera.”

The algorithm had a pretty high confidence score about this wrongheaded result. And despite my own lack of hardware experience, I wound up with more confidence too at the end of the day. I might not have become a Raspberry Pi expert, but next time I get my hands on one, I can certainly fumble a lot better.

Outcomes

Our Internet of Things (IoT) project brought together a few core technologies—a Raspberry Pi, cloud computing, and image recognition software. Our experiments gave us lots of ideas for how these fundamentals could be applied to the real world, like:

  • a visitor greeting system that would identify employees and guests entering the office

  • a portable handheld device that could identify objects and emotions in the real world

  • a zoo or arboretum exhibit that identifies the flora and fauna in real time

This hackathon granted me familiarity with new tools that I can draw on for future Metal Toad projects—especially as IoT becomes more and more important for our clients. My increased understanding of the hardware opens up a lot of insights for connecting the real world to the digital.

But the biggest takeaway from the hackathon, for me, was strengthening the bonds that help our team innovate and solve problems together. The freedom to experiment, fail, and fumble together gave us a chance to flex our creative-thinking muscles and strengthen our collaborative spirit.

Filed under:

Add new comment

Restricted HTML

  • Allowed HTML tags: <a href hreflang> <em> <strong> <cite> <blockquote cite> <code> <ul type> <ol start type> <li> <dl> <dt> <dd> <h2 id> <h3 id> <h4 id> <h5 id> <h6 id>
  • You can enable syntax highlighting of source code with the following tags: <code>, <blockcode>, <cpp>, <java>, <php>. The supported tag styles are: <foo>, [foo].
  • Web page addresses and email addresses turn into links automatically.
  • Lines and paragraphs break automatically.

About the Author

Brad Kouchi, Software Engineer

A professional developer with years of experience with HTML, CSS, and JavaScript. Brad has an interest in performance and optimization as well as improving user experience.

When not playing video games, he will be dreaming about making video games.

Brad is striving to uphold XKCD's Rule for Ten Thousand.

He is mostly harmless.

Ready for transformation?