{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":615403340,"defaultBranch":"main","name":"outlines","ownerLogin":"outlines-dev","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-03-17T16:01:18.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/144020531?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1719069810.0","currentOid":""},"activityList":{"items":[{"before":"4523160ff7aebf0febafa70aaf3362f751f1bee3","after":"954f81e11ce7635a8c52cbef4dcc266bad08e993","ref":"refs/heads/gh-pages","pushedAt":"2024-07-01T16:00:45.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 833f68f with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 833f68f with MkDocs version: 1.6.0"}},{"before":"a643cb0a20e4e5d0159258d46214fd3d7f831de9","after":"833f68f88b11b4cbd4149c14c2a18b22f2a60343","ref":"refs/heads/main","pushedAt":"2024-07-01T16:00:00.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Add abridged version of the .txt article on Coding For Structured Generation (#1012)\n\nI've added an abridged version this [post on the .txt\r\nblog](https://blog.dottxt.co/coding-for-structured-generation.html) to\r\nthe cookbook that should provide a good overview of a basic workflow for\r\ndeveloping code when working with structured generation.","shortMessageHtmlLink":"Add abridged version of the .txt article on Coding For Structured Gen…"}},{"before":"73456612d73d0ddee3464012be30423c4df084a2","after":"4523160ff7aebf0febafa70aaf3362f751f1bee3","ref":"refs/heads/gh-pages","pushedAt":"2024-06-30T20:21:40.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed a643cb0 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed a643cb0 with MkDocs version: 1.6.0"}},{"before":"2807dcac8f2dc3e511e70b759be7c26736f016dd","after":"a643cb0a20e4e5d0159258d46214fd3d7f831de9","ref":"refs/heads/main","pushedAt":"2024-06-30T20:20:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Improve `outlines.processors`, add integration tests to test_generate.py (#998)\n\nA lot of these fixes were intended for\r\nhttps://github.com/outlines-dev/outlines/pull/966 however that's blocked\r\nuntil there's a new `transformers` release.\r\n\r\nThese improvements are general to all models and will enable PRs\r\nresolving https://github.com/outlines-dev/outlines/issues/806 and\r\nhttps://github.com/outlines-dev/outlines/issues/965\r\n\r\n# Structure of `OutlinesLogitsProcessor`\r\n\r\nThe goal is to create a base class which allows a logits processors to\r\nbe implemented once and used for any `outlines.models` inference\r\nlibrary.\r\n\r\nTo accomplish this we must normalize the input array. It must have a\r\nconsistent type (`torch.Tensor`) and consistent dimensionality (2). We\r\ncan normalize both of these simply, and without any copy operations.\r\n\r\n`mlx.core.array`, `numpy.array`, and `torch.Tensor` all support [pythons\r\narray standard\r\n`__dlpack__`](https://data-apis.org/array-api/latest/API_specification/generated/array_api.array.__dlpack__.html).\r\nThis standard allows for casting between array types without copying.\r\n\r\n`torch.Tensor` is the only input type which cannot always be cast to any\r\nother type because torch tensors may live in GPU memory. Therefore, we\r\ncast all arrays to `torch.Tensor`, implement logits processors using\r\ntorch methods, and convert back to the original array type in\r\n`OutlinesLogitsProcessor`. See docstring of\r\n`OutlinesLogitsProcessor.__call__()` for more details.\r\n\r\n# Detailed Changes\r\n- Rename `BaseLogitsProcessor` to `OutlinesLogitsProcessor`\r\n- Ensure `OutlinesLogitsProcessor.process_logits()` is always passed a\r\n2D batch request with `torch.Tensor` logits and `List` input_ids. Also\r\nclean up code to be more readable in `OutlinesLogitsProcessor__call__()`\r\n- Ensure `FSMLogitsProcessor` allows unstable sequence ordering (beam\r\nsearch in transformers and vLLM change the order of sequences)\r\n- Update `tests/generate/test_generate.py` to cover more permutations of\r\n - regex / text \r\n - batch / single\r\n - greedy / multinomial / beam search\r\n - `stream()` / `generate()`\r\n- Ensure performance stability with difference array libraries through\r\n`benchmark_processors.py`","shortMessageHtmlLink":"Improve outlines.processors, add integration tests to test_generate…"}},{"before":"c4d9455a17708cbc43b12faaf8b41429040d85c9","after":"73456612d73d0ddee3464012be30423c4df084a2","ref":"refs/heads/gh-pages","pushedAt":"2024-06-28T23:28:35.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 2807dca with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 2807dca with MkDocs version: 1.6.0"}},{"before":"8406f4419561b57dea02a2b3dd4c5d6f4cbb62dd","after":"2807dcac8f2dc3e511e70b759be7c26736f016dd","ref":"refs/heads/main","pushedAt":"2024-06-28T23:27:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Add asknews example (#1008)\n\nAskNews is processing 300k articles per day on-premise with vLLM and\r\noutlines. Outlines enables much deeper analysis of each article, since\r\nthe LLM doesnt need to worry about structure. Instead, it can focus\r\nattention on important output like extracting \"Reporting Voice\" typed as\r\na `Literal[str]`.\r\n\r\nThanks to the maintainers of this project!","shortMessageHtmlLink":"Add asknews example (#1008)"}},{"before":"5306503d930f79eb647802ac4862e38141988c63","after":"c4d9455a17708cbc43b12faaf8b41429040d85c9","ref":"refs/heads/gh-pages","pushedAt":"2024-06-25T22:57:20.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 8406f44 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 8406f44 with MkDocs version: 1.6.0"}},{"before":"f7d525beb3c221788bb1de8fd550188fe3003bc2","after":"8406f4419561b57dea02a2b3dd4c5d6f4cbb62dd","ref":"refs/heads/main","pushedAt":"2024-06-25T22:56:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Update , enable requirement only on darwin, disable requirement on darwin","shortMessageHtmlLink":"Update , enable requirement only on darwin, disable requirement on da…"}},{"before":"f5dbfeaad0403279e70093cd9e37c9c88b9b536e","after":"5306503d930f79eb647802ac4862e38141988c63","ref":"refs/heads/gh-pages","pushedAt":"2024-06-24T15:51:02.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed f7d525b with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed f7d525b with MkDocs version: 1.6.0"}},{"before":"1bc2a30d800cefedadca52a545e7d9b8b5b690d3","after":"f7d525beb3c221788bb1de8fd550188fe3003bc2","ref":"refs/heads/main","pushedAt":"2024-06-24T15:50:24.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Adding the option to avoid displaying tqdm bars at inference with `vllm` (#1004)\n\nVery minor change that adds the possibility to avoid displaying progress\r\nbars within `outlines`. It is not changing the default behaviour and is\r\njust about adding an argument (`use_tqdm`) to the `LLM.generate` call.\r\n\r\nIt was useful for a personal project and I did not find another way to\r\ndo so, so I decided to PR this.","shortMessageHtmlLink":"Adding the option to avoid displaying tqdm bars at inference with `vl…"}},{"before":"4ff334d2d02c6b446ae57c8b2e2beb74491311ac","after":"f5dbfeaad0403279e70093cd9e37c9c88b9b536e","ref":"refs/heads/gh-pages","pushedAt":"2024-06-24T00:22:21.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 1bc2a30 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 1bc2a30 with MkDocs version: 1.6.0"}},{"before":"42206e2b56a5e719e91bd8635d7ad0d0979712e5","after":"1bc2a30d800cefedadca52a545e7d9b8b5b690d3","ref":"refs/heads/main","pushedAt":"2024-06-24T00:21:45.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"fix models.mlxlm whitespace prefix handling","shortMessageHtmlLink":"fix models.mlxlm whitespace prefix handling"}},{"before":"65814efca4c74904fae4735731746c1c041a2d84","after":"4ff334d2d02c6b446ae57c8b2e2beb74491311ac","ref":"refs/heads/gh-pages","pushedAt":"2024-06-24T00:21:37.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 42206e2 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 42206e2 with MkDocs version: 1.6.0"}},{"before":"7d594a114c9fceee6106a93349486be2c3d5dcfb","after":"42206e2b56a5e719e91bd8635d7ad0d0979712e5","ref":"refs/heads/main","pushedAt":"2024-06-24T00:20:54.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Ensure no implicit max_tokens in models.llamacpp","shortMessageHtmlLink":"Ensure no implicit max_tokens in models.llamacpp"}},{"before":"f9e0e5bdb6261984c2aa417e3d6a1002a4601f94","after":"65814efca4c74904fae4735731746c1c041a2d84","ref":"refs/heads/gh-pages","pushedAt":"2024-06-23T16:25:10.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 7d594a1 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 7d594a1 with MkDocs version: 1.6.0"}},{"before":"7934b316968aa8553df34bc520a3358d51c97f5e","after":"7d594a114c9fceee6106a93349486be2c3d5dcfb","ref":"refs/heads/main","pushedAt":"2024-06-23T16:24:34.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Add SimToM prompt recipe (#1002)\n\nHi devs, thanks a lot for building `outlines`! \r\n\r\nI saw @rlouf's\r\n[tweet](https://x.com/remilouf/status/1801889864641573104) the other day\r\nabout adding prompting techniques to your docs, so I decided to\r\ncontribute [Think Twice: Perspective-Taking Improves Large Language\r\nModels' Theory-of-Mind Capabilities](https://arxiv.org/abs/2311.10227)\r\n\r\nLet me know what you think and whether this is what you're after. I\r\nwould be happy to add more prompting techniques to the docs if that's of\r\ninterest.","shortMessageHtmlLink":"Add SimToM prompt recipe (#1002)"}},{"before":"84b33104eebf2528dff0fa6e87954c904888e538","after":"f9e0e5bdb6261984c2aa417e3d6a1002a4601f94","ref":"refs/heads/gh-pages","pushedAt":"2024-06-22T15:43:50.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 7934b31 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 7934b31 with MkDocs version: 1.6.0"}},{"before":"8dcd24eeb4dbfaa102e4c812920c7b1dba2a4362","after":"7934b316968aa8553df34bc520a3358d51c97f5e","ref":"refs/heads/main","pushedAt":"2024-06-22T15:43:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Add contributors, creation and update date","shortMessageHtmlLink":"Add contributors, creation and update date"}},{"before":"004c6c30c0dec3b239948603350ce4ec1fce8244","after":"84b33104eebf2528dff0fa6e87954c904888e538","ref":"refs/heads/gh-pages","pushedAt":"2024-06-22T15:14:23.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 8dcd24e with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 8dcd24e with MkDocs version: 1.6.0"}},{"before":"60e89f5706e3d0f9837e271e04a39fb6e81d92df","after":"8dcd24eeb4dbfaa102e4c812920c7b1dba2a4362","ref":"refs/heads/main","pushedAt":"2024-06-22T15:13:51.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"fix models.llamacpp vocabulary normalization function","shortMessageHtmlLink":"fix models.llamacpp vocabulary normalization function"}},{"before":"956d470179ab12436ba1ae7574e4cf86cb7b0080","after":"004c6c30c0dec3b239948603350ce4ec1fce8244","ref":"refs/heads/gh-pages","pushedAt":"2024-06-22T15:11:04.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 60e89f5 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 60e89f5 with MkDocs version: 1.6.0"}},{"before":"f20c77498657ff72a439e394a88633e45f00ee9f","after":"60e89f5706e3d0f9837e271e04a39fb6e81d92df","ref":"refs/heads/main","pushedAt":"2024-06-22T15:10:33.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"fix pattern-string in json_schema.py by removing anchors","shortMessageHtmlLink":"fix pattern-string in json_schema.py by removing anchors"}},{"before":"00e0b59fee76645131e467d56ded7d84f85beff6","after":"956d470179ab12436ba1ae7574e4cf86cb7b0080","ref":"refs/heads/gh-pages","pushedAt":"2024-06-20T11:48:24.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed f20c774 with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed f20c774 with MkDocs version: 1.6.0"}},{"before":"a9d58efd07661edf72249736aea52dbee0bef1e8","after":"f20c77498657ff72a439e394a88633e45f00ee9f","ref":"refs/heads/main","pushedAt":"2024-06-20T11:47:51.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Fix use of `os.environ` in documentation","shortMessageHtmlLink":"Fix use of os.environ in documentation"}},{"before":"063497de0d2180a06c5573b9b26ca2ed24655a61","after":"00e0b59fee76645131e467d56ded7d84f85beff6","ref":"refs/heads/gh-pages","pushedAt":"2024-06-20T05:30:35.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed a9d58ef with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed a9d58ef with MkDocs version: 1.6.0"}},{"before":"371313ef1c31c272cbbdb5cd792638e5afd540e0","after":"a9d58efd07661edf72249736aea52dbee0bef1e8","ref":"refs/heads/main","pushedAt":"2024-06-20T05:30:05.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Allow escaped strings in json_schema.py","shortMessageHtmlLink":"Allow escaped strings in json_schema.py"}},{"before":"3f23440e07b6b543ddb691e41c03e10f1707e303","after":"063497de0d2180a06c5573b9b26ca2ed24655a61","ref":"refs/heads/gh-pages","pushedAt":"2024-06-19T13:09:38.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 371313e with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 371313e with MkDocs version: 1.6.0"}},{"before":"7b8caeec12afe308ef126593955c1fb7310cb7f4","after":"371313ef1c31c272cbbdb5cd792638e5afd540e0","ref":"refs/heads/main","pushedAt":"2024-06-19T13:08:46.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"fix HF Hub ID","shortMessageHtmlLink":"fix HF Hub ID"}},{"before":"13f19518c252666c260b5a034da7edb2e5dd2806","after":"3f23440e07b6b543ddb691e41c03e10f1707e303","ref":"refs/heads/gh-pages","pushedAt":"2024-06-19T08:57:45.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 7b8caee with MkDocs version: 1.6.0","shortMessageHtmlLink":"Deployed 7b8caee with MkDocs version: 1.6.0"}},{"before":"7d8269fe246dce507719d3e4b2a2d838dc5bae7e","after":"7b8caeec12afe308ef126593955c1fb7310cb7f4","ref":"refs/heads/main","pushedAt":"2024-06-19T08:57:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rlouf","name":"Rémi Louf","path":"/rlouf","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3885044?s=80&v=4"},"commit":{"message":"Add link to docs of Multimodal Structured Generation for CVPR 2nd MMFM Challenge (#960)","shortMessageHtmlLink":"Add link to docs of Multimodal Structured Generation for CVPR 2nd MMF…"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEc_Or0gA","startCursor":null,"endCursor":null}},"title":"Activity · outlines-dev/outlines"}