test tvdb new impro

README.md

@@ -10,299 +10,156 @@ pinned: false
 ---
 
 
-## Scripts
-```
-app.py         ->  main script that run flask server
-hf_scrapper.py ->  script for interacting with huggingface
-indexer.py     ->  script to index the repo structure
-tvdb.py        ->  script to interact with TheTVDB
-```
-## Film and TV API
-
-This API provides endpoints for accessing and managing film and TV show data, including downloading, caching, and retrieving metadata.
+# API Documentation
 
-## Table of Contents
+This is a Flask-based API application that serves various endpoints to manage and retrieve information about films and TV shows, including caching, metadata, and download progress. The application functions as a load balancer to manage media content.
 
+## Prerequisites
 
-- [Base URL](#base-url)
-- [Endpoints](#endpoints)
-  - [Film Endpoints](#film-endpoints)
-  - [TV Show Endpoints](#tv-show-endpoints)
-  - [Cache Endpoints](#cache-endpoints)
-  - [Metadata Endpoints](#metadata-endpoints)
-  - [Miscellaneous Endpoints](#miscellaneous-endpoints)
-- [Error Handling](#error-handling)
-- [Running the Server](#running-the-server)
+- Python 3.10
+- Flask
+- Flask-CORS
+- requests
+- python-dotenv
+- tqdm
 
+## Installation
 
-## Base URL
+1. Clone the repository.
+2. Install the required packages using pip:
 
-All endpoints are accessed through the base URL:
-
-```markdown
-http://<server-address>:7860
-```
+    ```bash
+    pip install -r requirements.txt
+    ```
 
-Replace `<server-address>` with your server's address.
-
-## Endpoints
-
-### Film Endpoints
-
-#### `GET /api/film`
-
-**Description:** Starts the download of a film if it's not already cached.
-
-**Query Parameters:**
-- `title` (string): The title of the film.
-
-**Responses:**
-- `200 OK`: Download started successfully.
-  ```json
-  {
-    "status": "Download started",
-    "film_id": "film_id_here"
-  }
-  ```
-- `400 Bad Request`: Title parameter is required.
-  ```json
-  {
-    "error": "Title parameter is required"
-  }
-  ```
-- `404 Not Found`: Movie not found.
-
-#### `GET /api/film/store`
-
-**Description:** Retrieves the JSON data for the film store.
-
-**Responses:**
-- `200 OK`: Returns the film store JSON data.
-  ```json
-  {
-    "film_title": "cache_path_here"
-  }
-  ```
-- `404 Not Found`: Film store JSON not found.
-
-#### `GET /api/film/metadata`
-
-**Description:** Retrieves metadata for a film by title.
-
-**Query Parameters:**
-- `title` (string): The title of the film.
-
-**Responses:**
-- `200 OK`: Returns the metadata JSON for the film.
-  ```json
-  {
-    "title": "Film Title",
-    "year": 2024,
-    "metadata": { ... }
-  }
-  ```
-- `400 Bad Request`: No title provided.
-  ```json
-  {
-    "error": "No title provided"
-  }
-  ```
-- `404 Not Found`: Metadata not found.
-
-### TV Show Endpoints
-
-#### `GET /api/tv`
-
-**Description:** Starts the download of a TV show episode if it's not already cached.
-
-**Query Parameters:**
-- `title` (string): The title of the TV show.
-- `season` (string): The season number.
-- `episode` (string): The episode number.
-
-**Responses:**
-- `200 OK`: Download started successfully.
-  ```json
-  {
-    "status": "Download started",
-    "episode_id": "episode_id_here"
-  }
-  ```
-- `400 Bad Request`: Title, season, and episode parameters are required.
-  ```json
-  {
-    "error": "Title, season, and episode parameters are required"
-  }
-  ```
-- `404 Not Found`: TV show or episode not found.
-
-#### `GET /api/tv/store`
-
-**Description:** Retrieves the JSON data for the TV store.
-
-**Responses:**
-- `200 OK`: Returns the TV store JSON data.
-  ```json
-  {
-    "show_title": {
-      "season": {
-        "episode": "cache_path_here"
-      }
-    }
-  }
-  ```
-- `404 Not Found`: TV store JSON not found.
-
-#### `GET /api/tv/metadata`
-
-**Description:** Retrieves metadata for a TV show by title.
-
-**Query Parameters:**
-- `title` (string): The title of the TV show.
-
-**Responses:**
-- `200 OK`: Returns the metadata JSON for the TV show.
-  ```json
-  {
-    "title": "TV Show Title",
-    "seasons": [ ... ],
-    "metadata": { ... }
-  }
-  ```
-- `400 Bad Request`: No title provided.
-  ```json
-  {
-    "error": "No title provided"
-  }
-  ```
-- `404 Not Found`: Metadata not found.
-
-### Cache Endpoints
-
-#### `GET /api/cache/size`
-
-**Description:** Retrieves the total size of the cache.
-
-**Responses:**
-- `200 OK`: Returns the cache size in a human-readable format.
-  ```json
-  {
-    "cache_size": "10.5 MB"
-  }
-  ```
-
-#### `POST /api/cache/clear`
-
-**Description:** Clears the entire cache.
-
-**Responses:**
-- `200 OK`: Cache cleared successfully.
-  ```json
-  {
-    "status": "Cache cleared"
-  }
-  ```
-
-### Metadata Endpoints
-
-#### `GET /api/filmid`
-
-**Description:** Retrieves the film ID by title.
-
-**Query Parameters:**
-- `title` (string): The title of the film.
-
-**Responses:**
-- `200 OK`: Returns the film ID.
-  ```json
-  {
-    "film_id": "film_id_here"
-  }
-  ```
-- `400 Bad Request`: Title parameter is required.
-  ```json
-  {
-    "error": "Title parameter is required"
-  }
-  ```
-
-#### `GET /api/episodeid`
-
-**Description:** Retrieves the episode ID by title, season, and episode.
-
-**Query Parameters:**
-- `title` (string): The title of the TV show.
-- `season` (string): The season number.
-- `episode` (string): The episode number.
-
-**Responses:**
-- `200 OK`: Returns the episode ID.
-  ```json
-  {
-    "episode_id": "episode_id_here"
-  }
-  ```
-- `400 Bad Request`: Title, season, and episode parameters are required.
-  ```json
-  {
-    "error": "Title, season, and episode parameters are required"
-  }
-  ```
-
-### Miscellaneous Endpoints
-
-#### `GET /api/film/all`
-
-**Description:** Retrieves a list of all films.
-
-**Responses:**
-- `200 OK`: Returns a list of film paths.
-  ```json
-  [
-    "film_path_1",
-    "film_path_2"
-  ]
-  ```
-
-#### `GET /api/tv/all`
-
-**Description:** Retrieves a list of all TV shows.
-
-**Responses:**
-- `200 OK`: Returns a list of TV shows with their episodes.
-  ```json
-  {
-    "show_title": [
-      {
-        "season": "season_number",
-        "episode": "episode_title"
-      }
-    ]
-  }
-  ```
-
-## Error Handling
-
-All endpoints return standard HTTP status codes:
-- `200 OK` for successful requests.
-- `400 Bad Request` for invalid requests.
-- `404 Not Found` for missing resources.
-
-Errors are returned in the following format:
-```json
-{
-  "error": "Error message here"
-}
-```
+3. Set up the necessary environment variables:
+    - `CACHE_DIR`: Directory where cached files are stored.
+    - `INDEX_FILE`: Path to the index file.
+    - `TOKEN`: API token for Huggingface.
+    - `REPO`: Huggingface Repository URL.
+    - `THETVDB_API_KEY` : TheTVDB API key.
+    - `THETVDB_API_URL` : TheTVDB API url
 
-## Running the Server
+## Usage
 
-To run the server, ensure you have all required dependencies installed and use the following command:
+To start the Flask server, run:
 
 ```bash
 python app.py
 ```
 
-The server will start on `http://0.0.0.0:7860` by default.
+The server will run on `http://0.0.0.0:7860`.
+
+## API Endpoints
+
+### Get Movie by Title
+
+- **URL:** `/api/film/<title>`
+- **Method:** `GET`
+- **Description:** Retrieves the URL of the movie by its title. If not cached, it starts the download process.
+- **Parameters:**
+  - `title` (string): The title of the movie.
+
+### Get TV Show Episode by Title, Season, and Episode
+
+- **URL:** `/api/tv/<title>/<season>/<episode>`
+- **Method:** `GET`
+- **Description:** Retrieves the URL of the TV show episode by its title, season, and episode. If not cached, it starts the download process.
+- **Parameters:**
+  - `title` (string): The title of the TV show.
+  - `season` (string): The season number.
+  - `episode` (string): The episode number.
+
+### Get Film ID by Title
+
+- **URL:** `/api/filmid/<title>`
+- **Method:** `GET`
+- **Description:** Retrieves the film ID by providing the movie title.
+- **Parameters:**
+  - `title` (string): The title of the movie.
+
+### Get Episode ID by Title, Season, and Episode
+
+- **URL:** `/api/episodeid/<title>/<season>/<episode>`
+- **Method:** `GET`
+- **Description:** Retrieves the episode ID by providing the TV show title, season, and episode.
+- **Parameters:**
+  - `title` (string): The title of the TV show.
+  - `season` (string): The season number.
+  - `episode` (string): The episode number.
+
+### Get Cache Size
+
+- **URL:** `/api/cache/size`
+- **Method:** `GET`
+- **Description:** Retrieves the total size of the cache in a human-readable format.
+
+### Clear Cache
+
+- **URL:** `/api/cache/clear`
+- **Method:** `POST`
+- **Description:** Clears the entire cache.
+
+### Get TV Store JSON
+
+- **URL:** `/api/tv/store`
+- **Method:** `GET`
+- **Description:** Retrieves the TV store JSON.
+
+### Get Film Store JSON
+
+- **URL:** `/api/film/store`
+- **Method:** `GET`
+- **Description:** Retrieves the film store JSON.
+
+### Get Film Metadata by Title
+
+- **URL:** `/api/film/metadata/<title>`
+- **Method:** `GET`
+- **Description:** Retrieves the metadata of a film by its title.
+- **Parameters:**
+  - `title` (string): The title of the movie.
+
+### Get TV Show Metadata by Title
+
+- **URL:** `/api/tv/metadata/<title>`
+- **Method:** `GET`
+- **Description:** Retrieves the metadata of a TV show by its title.
+- **Parameters:**
+  - `title` (string): The title of the TV show.
+
+### Get All Films
+
+- **URL:** `/api/film/all`
+- **Method:** `GET`
+- **Description:** Retrieves a list of all films.
+
+### Get All TV Shows
+
+- **URL:** `/api/tv/all`
+- **Method:** `GET`
+- **Description:** Retrieves a list of all TV shows.
+
+### Get Instances
+
+- **URL:** `/api/instances`
+- **Method:** `GET`
+- **Description:** Retrieves a list of all registered instances.
+
+### Get Instances Health
+
+- **URL:** `/api/instances/health`
+- **Method:** `GET`
+- **Description:** Retrieves the health status of all registered instances.
+
+### Register Instance (Only for Instance)
+
+- **URL:** `/api/register`
+- **Method:** `POST`
+- **Description:** Registers a new instance.
+- **Request Body:**
+  - `url` (string): The URL of the instance.
+
+## License
 
----
+This project is licensed under the `MIT License`

app.py

@@ -92,12 +92,6 @@ def get_tv_show_api(title, season, episode):
     if response:
         return jsonify(response)
 
-@app.route('/api/progress/<id>', methods=['GET'])
-def get_progress_api(id):
-    """Endpoint to get the download progress of a movie or TV show episode."""
-    progress = load_balancer.get_download_progress(id)
-    return jsonify({"id": id, "progress": progress})
-
 @app.route('/api/filmid/<title>', methods=['GET'])
 def get_film_id_by_title_api(title):
     """Endpoint to get the film ID by providing the movie title."""
@@ -195,9 +189,15 @@ def get_all_films_api():
 def get_all_tvshows_api():
     return load_balancer.get_all_tv_shows()
 
+@app.route('/api/instances',methods=["GET"])
+def get_instances():
+    return load_balancer.instances
 
+@app.route('/api/instances/health',methods=["GET"])
+def get_instances_health():
+    return load_balancer.instances_health
 #############################################################
-# unique api's
+#  This API is only for instances
 @app.route('/api/register', methods=['POST'])
 def register_instance():
     try:
@@ -219,14 +219,6 @@ def register_instance():
         logging.error(f"Error registering instance: {e}")
         return jsonify({"error": "Failed to register instance"}), 500
     
-@app.route('/api/instances',methods=["GET"])
-def get_instances():
-    return load_balancer.instances
-
-@app.route('/api/instances/health',methods=["GET"])
-def get_instances_health():
-    return load_balancer.instances_health
-
 #############################################################
 # Routes
 @app.route('/')

tvdb.py

@@ -57,14 +57,28 @@ def fetch_and_cache_json(original_title, title, media_type, year=None):
     }
     
     try:
+        # Fetch initial search results
         response = requests.get(search_url, headers=headers, proxies=proxies)
         response.raise_for_status()
         data = response.json()
         
         if 'data' in data and data['data']:
+            # Extract the TVDB ID from the first result
+            tvdb_id = data['data'][0]['tvdb_id']
+            if not tvdb_id:
+                print("TVDB ID not found in the search results")
+                return
+            
+            # Request the extended information using the TVDB ID
+            extended_url = f"{THETVDB_API_URL}/movies/{tvdb_id}/extended?meta=translations"
+            response = requests.get(extended_url, headers=headers, proxies=proxies)
+            response.raise_for_status()
+            extended_data = response.json()
+            
+            # Cache the extended JSON response
             json_cache_path = os.path.join(CACHE_DIR, f"{urllib.parse.quote(original_title)}.json")
             with open(json_cache_path, 'w') as f:
-                json.dump(data, f)
+                json.dump(extended_data, f)
                 
     except requests.RequestException as e:
         print(f"Error fetching data: {e}")