Do I have to already be connected with someone to add them to a group conversation?

Yes. To add someone you're not connected with to a group conversation:

1. Connect with them using the search field in the conversation list.
2. Add them to a group conversation after they've accepted your connection request.