Tag: Apple

Open Sourced today! MLXPromptCache : dramatic increase in speed for local inference

As we build Tanuki on top of the amazing MLX local (inference) framework we are finding some surprising new capabilities that are going to completely reframe what can and cannot be...