Exactly what I do and it works like a charm.Just get a basic 5 port switch. You might want to pay a couple of quid extra for a Gigabit one if you have fibre or are transferring files round the house. Otherwise they'll all do the job.
Connect the Virgin Modem/Router to one port on the switch and and use the other 4 ports as you like.
Amazon product ASIN B07PYSNSDD