Well...just like the earlier poster said..you need to get rid of the Idle villes..set gather point to resources instead of standing there watching trees.
also when you used the Frost GP you attempted to destroy his fotress with a few TAs and Jarls?? that's exactly what the other guy wanted..you want to get your rams out quickly and use them to destory the fortress and use your troops to kill off as many villes as possible. personally i like WW GP better in that situation cus if they are not killed ..they can last alot longer than Frost.
Also you could have given up when Loki wiped out your main base..it's just a waste of time for him and you.