Local vision: detect the honeycomb cells and read values 1..6. Solver: solve the board as a modulo-6 linear puzzle. Executor: click by desktop mouse, plain ADB, or MaaTouch.
Shoes is a little DSL for cross-platform (Mac, Windows, and Linux) GUI programming. It feels like real Ruby, rather than just another C++ library wrapper. For some samples, the manual, and a free book ...