Yes! You can add multiple color bulbs at once.
At the beginning of the setup process (Wyze Color Bulb Setup Guide), install each color bulb you want to set up into light sockets. Turn on the power to each light socket, then continue to the network connection step.
Note: This feature is not available on the original Wyze Bulb.