If I had Olsen, I'd start him weekly regardless of opponent. I drafted him fairly early (in my PPR league), but dropped him when he got hurt, and wish I hadn't when someone else picked him up and I became thin at TE all season.
Full disclosure, in my non PPR league, I just picked up Brate as a Bye week fill-in for Kelce.