Technology

Pokédex in the real world You can specify the name of the game. Powered by ChatGPT and AI.

2024-02-13 09:24:44

Abe Haskins, a YouTuber and engineer who runs the YouTube channel Abe's Projects, has released a video of himself creating a Pokedex based on the 1990 Indigo League, which can be identified by name and accompanied by an audio description. and capture images with the camera using ChatGPT and AI to drive the system

In creating it, his main goal was to make it look as similar as possible to the anime version. Have it recognize most Pokémon in most situations. and need to be able to speak electronically All he needs is a camera sensor. A small screen to display the name and image of Pokemon. There is a speaker for playing the description. and a WIFI reception sensor to communicate with ChatGPT-4. The pin has added a battery, a USB port, and a few buttons for scanning and exiting. He used a 3D printer to build the machine.

In terms of audio, an online AI clone called PlayHT has been used. The text-to-speech software has had issues with the correct pronunciation of some Pokémon names. The device feeds camera sensor data to ChatGPT-4, which compares it to a database of images and Pokémon data via an API. The database consists of bitmap images paired with Pokémon names. Pictures display well on the small black and white OLED panel. But sometimes the text may be unreadable.

He tested the Pokédex with a few toys. It cannot correctly identify the doll. But it can remember actions and images on a computer screen quite well. His experiment this time is considered to be the realization of a childhood dream for many people. In addition to the Pokedex, there are other devices that he has created and published only on the channel.