The demonstrators said five people were arrested as the protest camp was broken-up following a High Court injunction granted last week.
The camp was occupied by anti-capitalist demonstrators and local people opposed to construction of the venue on Leyton Marsh .
A statement from the protesters said: “Five arrests were made of protestors who refused to move from the front gate where construction vehicles were waiting to enter.
“One local resident was pulled out from under a lorry by bailiffs before it could be allowed to enter the site.
The camp has now moved to a nearby grass verge.
The protesters said: “It’s not over yet, this could be the site we have been waiting for; a chance for activists and locals to fight.”