defog

/

sqlcoder-7b-2

like 301

Follow

Defog.ai 98

Now, I'm working with sql database, is there any chance to work with create_sql_agent function in langchain by using open source huggingface llm, or it will only work on openai models.
During the inferencing I got this error,

code:
model_name = 'chatdb/natural-sql-7b'
model_tok = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
agent_executor = create_sql_agent(
llm=model,
db=db,
verbose=True)

Error:
raise validation_error
pydantic.v1.error_wrappers.ValidationError: 1 validation error for SQLDatabaseToolkit

How to fix this problem