No, but purely technically speaking, it would be possible to have the Radix Wallet connect directly to dApp websites without the Connector browser extension. The issue is trust, security, and user experience.
The Connector extension implements the Radix Connect logic, but also passes information about dApps to the Radix Wallet with every request. This information helps the wallet verify that the source of the request is the correct official website for that dApp (using our on-ledger system of "dApp Definitions"). Basically it helps avoid things like fake dApp websites.
Also, the Connector extension implements a variety of bits of logic that ensure a smooth user experience, like coordinating multiple connections when using multiple dApp websites at the same time, intelligent retry logic, a single permission for system notifications (seeing a pop-up whenever a transaction completes, for example), and more.
If a library for dApp websites to run was published, the benefits above would be lost because users would in effect be downloading (and trusting) a separate connector extension embedded within each dApp they connected to. The experience wouldn't be nearly as seamless, and would lose the important security benefits.
So yes, it's a small bit of extra hassle, but it takes just a few seconds to set up, it's one click to install, you scan a QR code in your Radix Wallet, and then you never have to think about the Connector extension again. It just sits in the background (like a browser extension should) doing its thing for you.
In future, once Radix Wallet connections are enabled on mobile dApps, those won't require an extension – because the connection is local on the same device.
Further reading: