I'm wondering if I would be able to access, create recordsets automatically, queries, etc, with dreamweaver MX - in other words - contact the mysql database without using a SHH?

Yes Dreamweaver MX allows you to work directly with the mysql database. You just need to set your remote database as a "data source". Check the help files for instructions on that.