Reading the code linked to in the previous post and doing part A of the homework will help you with part B.  The code that you are completing in the CS 188 codebase does Q-Value iteration. Understanding how it works will help you finish the assignment. The methods you are asked to complete in the CS 188 code are not exact matches to methods from the previous post, but understanding the previous post will make it easier to understand the CS 188 code.