Hi
Yes, that's that simple. Of course I removed Your access, so cannot do this right now, but please edit file /html/com_virtuemart/category/default.php, look for this line and try copy it above while checking if manufacturer is in a desired place already.