Markov Crawler

by JanB5 in Circuits > Raspberry Pi

1551 Views, 2 Favorites, 0 Comments

Markov Crawler

Crawler can execute a reflex agent or Q-learn optimal policy using Markov decision process.

Raspberry Pi runs CS188 AI Python software controlling crawler 2 servo motors for arm and hand, acquiring crawler position from optical mouse.

Overview of the Project

Downloads

Assembly Instruction

Usage Instruction

Q-learning Process

https://youtu.be/Ex3Hbc69Aps

Execution of Q-learned Policy

https://youtu.be/C7HSPhb4rQ4

Synchronization of Simulator and Physical Robot

https://youtu.be/xYO9BCDn2AA