Remove the ice tray from the freezer. Empty any ice in the tray. Rinse the tray with warm water.
Prepare a solution of two teaspoons of baking soda and a half a cup of warm water. Place the ice tray in your kitchen sink and pour the solution into the tray. Use the cloth to wash each individual cube section.
Empty the baking soda solution from the tray. Rinse the tray with warm water until the water runs clear. Fill the cleaned tray with water and place it back in the freezer.