I would honestly just not have an expansion joint there....if you make it tight to your inlaid panel and put your expansion joint along the outside perimeter I think you'd be fine. Its glued down, and also in alternating directions making it more stable.
If you do put one at the panel it may...