"One of the things that Gemma 3 27B, the prior one had was definitely some context drop that kicked in about 32K and by the time you were at 64K, it was questionable the usefulness of most of what you were getting."