Paul, based upon my recent conversion from a CB Performance air cooled 2.1L with solid lifters and dual Weber 44 IDF carburetors to a Subaru water cooled 2.5L with fuel injection...
Fuel injection eliminates carburetor maintenance issues of clogged idle jets, the need to adjust float level, idle mixture, accelerator pump and idle speed, synchronizing multiple carburetors, experimenting with idle, main and air correction jet sizes and venturi sizes, tearing the top off the carburetor to remove water and dirt from the float bowl, and likely some additional maintenance tasks I've forgotten about. In theory, the precision of fuel injection should yield improvements in performance and efficiency when compared to carburetors on an air cooled motor, but I've witnessed some who struggled with their fuel injection conversion and moved back to carburetors. Carburetor and fuel injection both must be tuned appropriately for the motor, though fuel injection is more of a set-once-and-forget, assuming you get the tuning right the first time.
An air cooled motor with solid lifters requires periodic valve adjustment. An air cooled motor with hydraulic lifters requires less maintenance (assuming you don't have an hydraulic lifter failure), more in line with a typical water cooled motor. Fuel injection should make it easier to cold start, though I've rarely had any issues starting a carburetor motor with a manual choke or no choke at all.
Preference for the sound of carburetors vs fuel injection is in the ear of the beholder. If you want your car to sound like a, say, an original 1958 Speedster, you may be happier with a carburetor.
By converting to a larger, contemporary water cooled motor designed for fuel injection, I'm benefiting from significant improvements in torque, horsepower and gas mileage, and hopefully lower maintenance and higher reliability. This makes the car less "correct", straying from the original, but it's my daily driver, so low maintenance is important to me. And the acceleration :-)