Use wp.media templates to create totally custom modal

Following up on this answer I'm trying to determine how to create a modal with completely unique menu items/content than the media modal.

If you add a new state you can add a new menu tab and have it render the appropriate content when clicked. However, what I've found so far is that if you don't include the traditonal wp.media.controller.Library() states (for gallery, insert, etc) then the menu does not render at all and you are left with an empty media frame.

I've started a gist for a plugin, and the modal opens, but so far there's nothing in it.

Does anyone know how to create custom frames with custom states?