#SUPERTUXKART ICE HOCKEY HOW TO#
#SUPERTUXKART ICE HOCKEY TRIAL#

We found that the goalie/chaser combination performed the best against the TA agents, but it was still not good enough to consistently beat them, especially the better agents(Jurgen). After creating this goalie behavior, we tried different combinations of two naive chasers, one goalie/chaser, and two goalies. The advantage of this approach was that it would ensure that the agents would only hit the puck towards the enemy goal, rather than its own goal, and have a higher chance of having a good angle to hit the puck into the enemy goal. The next improvement we made to the naive chaser agents was to create a “goalie” agent that would chase the puck whenever the puck was between itself and the enemy goal, but if the agent ever passed the puck then it would reverse towards its own goal until it was behind the puck, and then begin chasing again. While this fix solved the issue of the karts being stuck, we quickly realized that the approach of using two chaser agents was not adequate to consistently beat the TA agents or score at least one goal/game. To fix this issue, we created an instance variable to track if an agent was stuck based on how long its velocity remained below a certain threshold, and once we determined that it was stuck we set it to reverse for a certain number of frames before proceeding to chase the puck again. However, we immediately ran into a problem with this approach where our agents would eventually get stuck against a wall and be unable to reverse since we coded them to only drive forward. Our initial strategy was to only steer towards the puck and move forward, setting both agents to constantly chase the puck. Our next plan was to create a hand-tuned controller AI that outperformed Jurgen so that we could learn from something better than the bots we would compete with.

So, the first main optimization was to collect action state pairs from both sides of the field. We realized that we were only training from a single side of the field and that the network only drove in circles when we had it play the other side. In order to fix this we did data shuffling and training on 150 games taken equally from each agent vs. The first issue we encountered was making the first imitation learning model, because we had improper shuffling (sequential data) which produced very poor models.

#SUPERTUXKART ICE HOCKEY HOW TO#

This initial implementation scored poorly and gave us ideas on how to continue. First, we collected games where Jurgen plays itself and fed them into a network, and learned state action pairs. We started by implementing a basic off-policy imitation learning model on the Jurgen agent. We took four different implementation approaches for our project: imitation learning, reinforcement learning, gradient-free optimization, and imitation learning with DAGGER. Our team decided to use a state based approach that learns state action relationships because the state based approach gave us access to game state information that was not provided in the image agent. The goal of our AI is to be able to defeat precoded opponents and challenge other teams' AI. In this project, we attempt to learn to play hockey in SuperTuxKart with a neural network using a state based agent.

#SUPERTUXKART ICE HOCKEY TRIAL#

Placed first among all state based agents Trial game where we put our agent against the ta agent trial.mp4 Final game played between the top 2 teams final_win.mp4 Group MembersĪlbin Shrestha, Andrew Wu, Bruce Moe, John Mackie, and Varad Thorat Introduction

A state based learning approach to winning a game of hockey with cars in Supertuxkart Now all of a sudden it Only shows up in a totally different state and with exact name search. Is there something I could do to send signals to Google to show that I am in Matthews, NC?Ģ months ago my listing quit showing up at all unless you typed exact business name What could possibly cause my listing or Google to do this? I have been without my listing for a few months now and have NO calls coming in from it.

If you search Locksmith Independence, KS it shows up on the maps. If you search Locksmith Matthews, NC my listing does not show up at all. Keep in mind the GMB is in Matthews, NC All my service areas and the actual map show the correct areas. Now if I search my business name under the auto populate I see it with Independence, KS on the listing.

I pretty much do not have any traffic, views or calls now. Posted about my SAB listing a few weeks ago about not showing up in search only when you entered the exact name.

Supertuxkart ice hockey