Latest Updates & Improvements to Faraday
- Reusable User Personas
- On the General Settings page, you can now create reusable personas that can be applied to any character
- Each persona includes a name, description, and image
- Llama 3 Inference Fixes
- Fixed repeating issues for most models
- Fixed issue where </s> would output at the end of every generation
- Added better ROPE calculation for Llama 3 models at long context lengths
- Better GPU detection on Experimental backend
- Cloud Update - Llama 3 Models
- PRO: Added Llama3 Solana 8B at 16,384 tokens of context
- STANDARD: Added Llama 3 Soliloquy 8B at 4,096 tokens of context
- Bug fixes & improvements
- Fixed edit message button always showing on mobile web
- Minor UI fixes on chat page & character settings page
0.18.5 - 0.18.8 Internal
- Hotfix
- Fix issue where characters would forget recent context
- Fix cloud streaming on desktop
0.18.2 - 0.18.3 Internal
- Support for Llama 3 base model
- If using a custom model, we recommend that you use the "Llama3" prompt template in the Character settings
- New "Experimental" Backend in Advanced Settings
- Support for all IQ quants
- Performance improvements for CUDA, Vulcan, and Metal
- Up to 40% faster prompt evaluation speeds for CPU
- Faster inference for chats that include grammars
- Cloud Infrastructure Improvements
- Significantly reduced wait times for all PRO plan models
- Faster token rates for Midnight-Rose 70B
- Faster token rates for all STANDARD models
- Fix for occasional “socket” errors after sending a message
- Bug fixes & Improvements
- Better mobile chat UI
- Increased max length for author’s comment on Hub
- Fix overflow for input fields on the Character creation page
- Fixed infinite loading on the Advanced Settings for some Windows devices
- Confirmation warning before irreversible undo operations
- Delete cached images after deleting a Character
- Fixes "maximum call stack exceeded" error when exporting a Character card
0.18.0 Internal
- Multiple Character images
- Support for adding up to 10 images to a Character
- Ability to scroll through images in the chat page sidebar, and on the Character Hub
- More TTS voices
- Bug fixes and improvements
- Enabled TTS voices in the browser
- Add alphabetical sorting to local homepage
- Increase default model context to 4096
- Fix issue where clicking undo would focus the button
- Fix to prevent overlapping TTS voices
- Fixed issue where GPU settings page would not load
- Fixed issue where images with the same name would overwrite each other
0.17.5 - 0.17.6 Internal
- Bug fixes and improvements
- Improve model context management for new example dialogue pruning feature
- Fix for occasional empty responses from the model
- Fix "invalid access to closed websocket" error
- Fix for missing and duplicated regenerations
0.17.3 Internal
- Hotfix
- Fix for issue preventing app startup when offline
- Fix for UI issue preventing menu from showing on homepage character cards
- Faraday Cloud - New Subscription Plans
- Pro: unlimited messages for Midnight-Rose 70B, Psyonic-Cetacean 20B, and Mythomax 13B (up to 10k context)
- Standard: unlimited messages for Mythomax 13B, Psyfighter 2 13B, and Toppy 7B (4k context)
- Free: 100 messages per week on Standard plan models
- Bug fixes and improvements
- Toggle to remove example dialogue on long chats
- Fix issue where regenerations would crash the chat
- Fix chat exports missing JSON extension
- Fix Character exports overriding previous exports
- Fix issue where duplicating Characters would silently fail
- Fix Character hub metrics not updating after duplicating
- New "Experimental" backend update with support for IQ quants
- Website landing page update
0.17.0 Internal
- Remove support for ggml files
- .bin files are no longer shown in the model manager
- Only .gguf files are supported now
- If you need help finding a .gguf model, message us on Discord
- GPU Fixes for MacOS
- Fixed issue where Intel based Macs would not use the GPU
- Fixed issue where some M1 Macs would not use the GPU
- Small bug fixes and improvements
- Fixed issue where the message send button was not working on desktop
- Handful of small UI fixes
- Fixed "auth not valid" issue some users were seeing when using cloud models
- Fixed auth issue when logging into two different accounts on the same device
- Desktop-to-Mobile Tethering
- Connect to your Faraday desktop app from your mobile browser
- All data is stored locally on your computer
- Default Off - Can be toggled on and off in the settings
- Learn more: docs.faraday.dev/tethering
- Other fixes & improvements
- Better VRAM handling on MacOS
- Better error messages when the model fails to start on Windows
- More improvements to the Windows GPU auto-detection system
- Fixed issue where some GPUs would not be detected
- Fixed issue where some GPUs would be detected but not selectable
- Fixed various issues with Vulkan-based GPU acceleration
- Allow for arbitrary maximum context length in Advanced Settings
- Fix colons appearing randomly in the output