A driving fish through image recognition on a smartphone with 5G

Why work with us:

– We improve your accessibility
– We enhance your customer experience
– We increase your efficiency

Want to know how we’ve been using AI to enhance the customer experience for years?

“With Pegamento, we found not just a supplier, but a true partner in change. Thanks to their expertise and our joint DevOps approach, we have made great strides in a short time. The technology supports our people so they can focus on where they make a difference: personal contact with entrepreneurs.”

Image recognition app: Did you ever think you’d see a fish drive by? You saw it right. Image recognition knows no bounds.

It’s been a while now (2014) since “Fish on wheels” went viral. Did you miss it? No problem, we’ll tell you again. The Fish on wheels, (FOW) is a self-steering fish bowl on wheels. The FOW consists of a chassis of a steerable car and a water tank with a structure consisting of a smartphone with an image recognition application above it.  The smartphone’s camera records the position of the fish based on a grid of nine planes. Does the fish swim in the right-middle plane? Then the car incl. the fish drives to the right. Does the fish swim in the middle-left plane? Then the car drives to the left and so on. At the time, the FOW was a project to explore the possibilities of image recognition. Despite this, the story of FOW went viral and BBC, among others, covered it.  

Image recognition application and 5G

The FOW works through an image recognition application and 5G. But what does a moving fish have to do with image recognition and 5G? Don’t worry, it’s not a conspiracy theory or rocket-science, you can leave the tinfoil hat in the drawer.

The human eye is able to see its surroundings, just like a camera. But the brain is needed to link meaning. Like recognizing people, looking for stuff or recognizing the color of your own car. In this case, the Cloud is the brain behind the camera. The camera is the proverbial eye.

The camera records data that can then be linked to the execution of an action. In the case of FOW, an image recognition system recognizes the orange color of the fish, and based on the position of the color orange (the fish) links an action that is performed by hardware. In this case, that is driving and steering a motorized set of wheels. The main element of image recognition is the camera, but the data recorded by the camera goes directly to a server in the 5G network via a 5G connection. This server converts this data to an action to be performed and sends it back to the smartphone which ensures that this command is executed by the hardware. This allows live images of photos and videos to be processed in real time and with minimal delay.

Why 5G and not just a smartphone application? You may be wondering. Using 5G and a separate server avoids heavy applications that consume a lot of data on mobile devices. All the complicated and heavy data sets and calculations are done in the Cloud. This makes deploying image recognition on mobile devices easier and more accessible.

Making the most of 5G speed

Now that smartphones have a lot of computing power and the connections are so good due to 5G networks, among other things, two options have emerged for implementing image recognition. It is possible to set up an app so that image recognition is performed on the phone itself, or to upload the image to a server where it can be processed and the result sent back. Both ways have their advantages and disadvantages.

On the smartphone, computing power is somewhat more limited, but the user is not dependent on a connection and its speed. However, an improvement to image recognition will have to be made by an app update or updating the data in the app again. In the Cloud, on the other hand, computing power is abundant and an update can be rolled out to millions of users within seconds. The downside, however, is that data always needs to be sent back and forth.  

In addition to riding fish, 5G and image recognition a combination that can be used in more applications on smartphones.

Examples of image recognition application + 5G

Growing with an image recognition applicationPegamentohas developed a special software where it is possible to take a 3D scan with your smartphone to determine your height. Parents with growth-impaired children can thus take an objective measurement that can be reliably shared with the relevant doctor. A home height measurement has not always proven reliable in the past. The  app gives parents and children more control over the exact effect of treatment and saves unnecessary visits to the hospital.

Recognizing artImage recognitioncan also be used to recognize objects. As you may already know from Google image search. However, this option can also be used in real time on smartphones. An example of this is  Smartify. Have you been asking yourself for a while what artwork is hanging in the dentist’s waiting room? Scan it with your phone and Smartify tells you who the artist is, what the artwork is called, when it was created and even the materials used. That way waiting at the dentist won’t take so long anymore.

You might also find this interesting to read: the unlimited possibilities with image recognition.

But beyond deploying 5G and image recognition for a driving fish or tracking body height, the possibilities are endless. We discuss these in our white paper. We also discuss various applications in a wide range of industries anno 2021. Curious? Take a look, after all, it is completely non-committal.

Free: Image recognition for dummies

Everything you want to know about image recognition.

More blogs

Download the white paper here

Deepen your knowledge with Pegamento’s white papers.

Ernst Vegter-Business consultant Pegamento

Ernst Vegter

Business Consultant

Hospitality is one of my deepest motivations.
Not surprisingly, of course, customer service is a common thread in my career. Aspects of hospitality is being able to connect, to facilitate but mainly to make someone feel genuinely welcome. My intuition is my greatest asset to be able to put myself in the shoes of a guest. A customer is my guest.

Fed by various senses, an image forms around the client. I listen to what is being said, watch facial expressions, taste the underlying tone and get a feel for the challenge to be addressed. An image literally forms on my retina. I have to be able to see it. If I can see it, I can create it.

In this, the trick is to pursue simplicity, give the client a warm feeling that the problem is understood, receive good advice, facilitated and carefully guided to the solution. Trust, connect and unburden.

The feeling when a guest arrives at your hotel after a long tiring journey, can sit in front of the fireplace, be handed a good glass of wine and stare carefree at the fire. My guest knows it will be okay.

This piece was written by Ernst Vegter, working as a Business Consultant at Pegamento.

Ger Koedam-Communication & Marketing Pegamento

Ger Koedam

Marketing & Communications

How can I help you? That’s pretty much the first question I ask when talking to people who are curious about our services. In such a conversation, the use of senses is very important. Because not everyone is the same. One person thinks in images, while for another words are important or how something feels. For me, sight and hearing are the most beautiful senses, because both eyes and ears absorb information and can convey or process emotions.

Why hearing? Because listening is essential in contact. And it’s the key to unlocking valuable insights.

I developed this skill early on. As a child, I enjoyed radio plays on the radio, bringing the stories to life in my head.

Rob Roode-Research Development

Rob Roode

Research & Development

Recognizing and automating patterns. Tasks we are constantly working on when implementing our robots at Pegamento. My 2 Drentsche Patrijshonden are hunting dogs and certainly not robots. The hunting instinct and intuition is basically in their genes. Continuing to offer new forms of training has taught them to recognize and act independently in hunting situations. Even “unsupervised,” even if I’m not around.

But when you try to teach a brain something, it also starts to see things you don’t expect. Dogs pick up on the slightest deviation in your voice or directions. To start recognizing that and correcting it again is perhaps the most complex challenge. But in our work, for the wonderful clients for whom we get to work, it often yields the most beautiful new insights!

This piece was written by Rob, founder of Pegamento and in charge of Marketing and R&D.

Serge Poppes-CEO Pegamento

Serge Poppes

CEO

Feeling. That’s the best thing Pegamento stands for. Feeling for technology in the broadest sense of the word. Not only feeling for the exciting stuff like AI, but also for the basics of communication.

The very best part of my job is selling, listening, translating and thinking about what really matters. We bring the digital transformation with a great team!
The diversity of our team, how sharp we are, but especially the wonderful things we get to make makes me feel extremely good. Hence, I intuitively chose the sense of “feeling.

Feeling gives life and differentiation!