AI basketball referee, walking is special, ask harden care don't care

Alex from Concave Fei Temple
qubit | public account QbitAI

Basketball players should know that walking is one of the most common violations in the game.

In order to better monitor whether players walk in basketball games, a little brother named @Ayush Pai (let's call him AP brother)) came up with an AI referee.

As you can see, the computer "watches" the basketball player all the time and can immediately tell if the person is walking.

This AI basketball referee quickly attracted a group of netizens to watch.

Some people joked that if the NBA used this AI referee, they would be finished.(Because NBA referees sometimes don't blow away)

Some people say that this AI seems to be very helpful in regulating children's basketball.

There is also a smart person who suggested that Brother AP design another Oscar-winning error detection AI.(Doge)

So having said that, how did this AI referee have such a "sightly eye"?

Mainly track the trajectory and steps of the ball

As you may have guessed, this AI referee is mainly created based on computer vision (CV).

The AI ​​mainly tracks two things: the trajectory of the ball and the number of steps a person takes.

In order to achieve this, the timing of the dribble will be detected first.

First, Brother AP wrote a set of CV algorithms to detect the bouncing of the ball and stream the camera's view, that is, extract video frames in sequence.

The AP then created an Aegis v image color mask to identify and filter out the color of the basketball.

In the computer daemon, the basketball is displayed in white, and other objects of different colors than the basketball are displayed in black; because only the ball is recognized and placed in the maskmiddle.

However, the interfering colors caused some irregular pixel blocks to appear around the basketball. In order to optimize this problem, AP brother deleted some post-processing code and made a circle around the ball.round to make it look neater.

In order to better track the bounce of the basketball, Brother AP measured its radius, obtained a vertex based on the radius of the ball and the center point, and then used a parabolic function to represent the ballmovement trajectory.When the vertex reaches the minimum value, the basketball has touched the ground.

After the basketball identification problem is solved, the next step is to count the number of steps people take while dribbling.

The pedometer on the Apple Watch does not update in real time.

So AP brother simply did it himself and designed a real-time counting pedometer.

He created an Android application that detects and counts steps based on acceleration in the three axes of x, y, and z, and feeds this data back to a Python program.

Finally, by combining the two datasets that monitor the trajectory of the ball and the number of steps, it is possible to determine whether a person has walking behavior.

However, the current AI referee is not "perfect" enough. Some netizens pointed out that this AI does not seem to recognize the gather step that is popular in the NBA today (Harden should be more familiar with this)).

In this regard, AP said that he will add this function to it later.

Are you optimistic about this AI basketball referee?By the way, AP brother has open sourced his algorithm on GitHub, interested partners can go and have a look~

Portal:
https://github.com/ayushpai/Basketball-Detector
Reference link:
[1]https://www.youtube.com/watch?v=3UeoKxw8UYs
[2]https://www.reddit.com/r/MachineLearning/comments/wbwkwb/i_created_a_cvbased_automated_basketball_referee_p/