AWS is a few layers below that service. You can't tell AWS "give me a domain with baserow installed". Or at least not without going through the layers of describing how it's mapped to actual compute resources and how is deployed.
It requires a lot of work and very low level configuration to go beyond the infrastructure elements. Databases? - sure. Managed apps? - here's a book on vpcs, subnets, and eni attachments in AWS.
