there seems to be a simple workaround where you can just add description of the preferred json schema directly into the prompt at the end of the prompt. Something like.... "format response in JSON with schema {"ice cream flavor":"text","description":"text"}" ...seems to work for me.