During the Anglo-Boer War which took place between 1899 and 1902, East London served as an important port of entry for supplies. Most of East London and King Williams Towns' white inhabitants supported the cause of the British, and a large number of streets in the area were named after Colonial and British Generals, for example Lukin, Brabant, Buller, Kitchener, Roberts and French. Many fine residences sprang up in the suburb of Belgravia, as a result of the expansion of trade in the region, one of which was the building which now houses the Anne Bryant Art. Gallery. While the Buffalo City area saw no military conflicts, many of the Colonial Division units were raised in the area, and the Equestrian Statue was erected as a memorial to those killed in action.

The bronze horse statue is mounted on a plinth of Irish marble, and stands in the front entrance of the East London City Hall in Oxford Street. The statue depicts a mounted military scout, and was sculptured by W. Reynolds-Stephens of London. The statue was modelled on the figure of Captain J.G Hearns M.C who belonged to the Cape Mounted Rifle Regiment, and the horse in the sculpture was modelled on a horse named "Boodles". An inscription on the memorial reads:

 "This statue was erected to the memory of the officers and men of the Colonial Division who lost their lives in the Anglo-Boer War 1899-1902".

The names of men from the Cape Mounted Rifes, the Queenstown Rifle Volunteers, Border Horse, Cape Medical Corps, and two regiments of Brabant's Horse are also displayed. The Equestrian Statue was officially unveiled in November of 1908 by Sir E.Y Brabant who was the Commandant General of the Colonial Defense Force, and it was awarded the title of best equestrian statue, by the Royal Academy in 1910.