Carillion Construction Ltd, Febrey Ltd and director Michael Febrey, were prosecuted by the HSE following the incident at the Meridian Quay apartment development in January 2008.
Carillion was fined £130,000 at an earlier hearing last November but Febrey Ltd received only a token £85 fine after going into liquidation soon after the tragedy.
Sentencing against Mr Febrey was adjourned until a hearing yesterday.
Swansea Crown Court heard that self-employed father of two Russell Samuel, from Porth, was contracted by Febrey Ltd to work as a scaffolder at the site.
He was dismantling a scaffold ladder access platform ahead of the installation of a roof and staircase on the fourth floor when he fell around 19 metres to the ground, narrowly missing a carpenter working directly below.
An HSE investigation found Febrey Ltd’s management team on site was not adequately trained in health and safety, despite repeated warnings by its health and safety consultants.
Mr Febrey was aware of the failings within his company – his workforce had raised concerns about the site – yet he failed to take responsibility for the company’s failings which allowed this culture to continue.
Michael Febrey of Bristol pleaded guilty to two safety breaches and was fined £20,000 and ordered to pay £5,000 in costs.
Speaking after the hearing, HSE Inspector Anne Marie Orrells said: “Febrey Ltd did not manage health and safety.
“This culture was allowed to continue without proper managerial intervention and for that reason Mr Febrey, as the managing director, must bear a portion of direct responsibility.
“There was a void in the company’s organisation, which Mr Febrey must have recognised, but did not rectify.”