Better if you think about clusters as “physical environments”, because that’s what they are and you have to pay for them. Functionally speaking, yes, you can have different libraries installed in different clusters.

I’m not sure what is your specific use-case for this but… you could also have a look at %pip command, that can be used for installing notebook scoped libraries. In that way you could use different library versions in the same cluster. But I would only advice this for development purposes.