I know the fact that the words which are always capitalized aren't permitted in Scrabble. But there are some French loanwords incorporated into English, which aren't capitalized and aren't proper names in any way but contain a letter with a diacritical mark. Perhaps most well-known examples are café, né (and née), fiancé (and fiancée), and naïve.
But standard English Scrabble set does not have É or Ï or any other letter with a diacritic.
I wonder if the words evidentiated in bold are OK to play in English Scrabble. (E. g. if I can play CAFE instead of CAFÉ.) I'd be very glad if I could watch an actual game with such a word. Thanks.