llm-arch / src /architectures.py

Commit History

Reviewed comments and type hints
8f8b146

alfraser commited on

Made updates to support automatic reload of the TestGroups after a test run
e35ef72

alfraser commited on

Marked the logger as a daemon thread so it doesn't prevent the exit of the python interpreter
d5cf91c

alfraser commited on

Fixed bug where the Logger was logging its own name and not that of the architecture.
30696ca

alfraser commited on

Implemented single threaded worker on writing the logs to the json file for controlled access to the resource on the file system now we are multi-threading the tests.
c0a1e47

alfraser commited on

Fixed display of architecture name
d6b7bf0

alfraser commited on

Logged start of architecture invocation so if one stalls you can see what it is in the logs
bdc40cf

alfraser commited on

Added raw prompt format to just do passthrough so I can test a number of different examples just typed in
92aa543

alfraser commited on

Added another test prompt format
20cff9b

alfraser commited on

Fixed bug with default prompt style not being valid
190ec66

alfraser commited on

Configured more architectures to try and debug the fine-tuning issue each with different prompt styles
53169ab

alfraser commited on

Added option to directly pass the HF hub token when wiping the trace file, so I can use it locally outside of streamlit. Defaulted to None avoid changing existing behaviour.
3853f7c

alfraser commited on

Fixed bugs from the refactor of repo access. Now it should save trace again.
f10615b

alfraser commited on

Refactored to bring common variables together. Also added a utility to get all the trace records as a list of records
8f424fc

alfraser commited on

Tweaked the way the prompt is formatted going into the LLM query, to avoid the fine-tuned model giving nonsense answers
2022fec

alfraser commited on

Added ability to wipe the logs from the system status page
c0f0676

alfraser commited on

Added the comment to the actual save
e47e542

alfraser commited on

Added ability to include comments on the saved trace
53697b7

alfraser commited on

Added saving of the trace data
745c1f4

alfraser commited on

Fixed typo in comment.
53ccfca

alfraser commited on

Removed debug print statements which cause extra chaff in the logs
1c63a8a

alfraser commited on

Removed now unused code which calls huggin face via the free HTTP interface - moved everything to endpoints to be equivalent.
227dc25

alfraser commited on

Added user messaging when the endpoint is down.
0adaf44

alfraser commited on

Added option to name an inference endpoint so it is human readable
27e1387

alfraser commited on

Added a new architecture component which calls hugging face via a dedicated inference end point and not the HTTP interface - needed due to the size of the fine-tuned model
6000142

alfraser commited on

Added and configured a component to trim the architectures to remove some common junk referencing the vector retrieved documents.
d02c4c7

alfraser commited on

Fixed a display issue in the markdown with dollar signs in prices
aff284c

alfraser commited on

Added option to include a diagram of the architecture under test on the architectures page.
2db4636

alfraser commited on

Modified the input screener to be simple profanity check.
d246d52

alfraser commited on

Added ability to include a message in the trace from the component when it triggers an early exit in the pipeline.
3af3634

alfraser commited on

Added the ability with the HF models to pass the temperature through from the config to the model, and added a sample which is effectively deterministic.
aee0ded

alfraser commited on

Added the safety checks on the input and the response.
bd6f44c

alfraser commited on

Integrated the architecture page structure and code from the old codebase and integrated for hugging face deployment
cc9a95f

alfraser commited on

Initial merge in of architectures from old codebase before I modify the HF access
e94696c

alfraser commited on