Partially functional on Llama

all_truncated_outputs.json

@@ -0,0 +1,584 @@
+[
+    "",
+    "That game",
+    "I can see",
+    "Hmm, this",
+    "I can relate to",
+    "Who is",
+    "I understand the",
+    "Ugh,",
+    "What the hell was",
+    "Hey, did anyone",
+    "Although",
+    "Thank you for choosing",
+    "What are you",
+    "Oh w",
+    "How dare you open",
+    "It was my pleasure",
+    "I'm hon",
+    "I appreciate that you",
+    "Are you k",
+    "Whoever left this",
+    "It's always",
+    "Ew,",
+    "Hey, I l",
+    "Hello? Is someone",
+    "I understand that",
+    "That poem",
+    "Aww, poor",
+    "Hey, it",
+    "Alright, who",
+    "I didn't",
+    "Well, life",
+    "The document",
+    "Oh no, this",
+    "I'm concerned",
+    "Hello, this is",
+    "This art",
+    "Hmm, this drink",
+    "Hi there!",
+    "It seems",
+    "Is",
+    "Good",
+    "I can't",
+    "Ex",
+    "Who are",
+    "I can see that",
+    "Wow,",
+    "Today is a",
+    "Hey friend",
+    "Sometimes friends",
+    "Oh, this old",
+    "The weather outside",
+    "This place is sur",
+    "I appreciate your input",
+    "Thank you for the",
+    "Look at",
+    "I'm disappoint",
+    "To my",
+    "How dare you",
+    "That's an",
+    "This piece of art",
+    "Eww",
+    "This park is",
+    "This is incredible",
+    "Oh no, someone",
+    "Exc",
+    "Well, it'",
+    "I warned",
+    "Hey, I understand",
+    "Hey, I saw",
+    "How dare you go",
+    "What the he",
+    "Hey",
+    "It's",
+    "Hello? Hello?",
+    "It",
+    "Oh no!",
+    "This is the perfect",
+    "Good morning,",
+    "Oh no, there",
+    "It's so",
+    "Yeah",
+    "Uh,",
+    "Hello everyone",
+    "Who turned off",
+    "The weather",
+    "Who'",
+    "Hey, this",
+    "Wait,",
+    "Eww, gross",
+    "Excuse",
+    "It seems like you",
+    "Thank you so",
+    "What happened?",
+    "Oh my g",
+    "I am deeply sad",
+    "I war",
+    "Okay, let'",
+    "Hey, that",
+    "That was a beautiful",
+    "Oh no! That",
+    "What happened",
+    "Hey there",
+    "The artist'",
+    "What?!",
+    "Hey, it'",
+    "I am disappoint",
+    "It seems like",
+    "Oh no! The",
+    "This park is a",
+    "If you",
+    "Yes! I did",
+    "It sounds",
+    "What",
+    "Who is it",
+    "Hmm, that",
+    "That's strange",
+    "Yeah, that was",
+    "That's interesting",
+    "This park",
+    "What the hell",
+    "Who is that",
+    "I feel like my",
+    "Oh well",
+    "What the hell is",
+    "Hello? Hello",
+    "To my dearest",
+    "Bless you!\"",
+    "Thank you for",
+    "Oh, looks like",
+    "Can you please",
+    "This place is",
+    "Eww, what",
+    "Bless you",
+    "Is everything",
+    "Hey, I just",
+    "Whoever left these",
+    "Well, that'",
+    "I feel",
+    "Hey, do you",
+    "It's sad",
+    "Oh no, it",
+    "Hey, that'",
+    "Oh my god,",
+    "Thank you,",
+    "Hello little one,",
+    "I apolog",
+    "Hey team, I",
+    "How dare you read",
+    "Who is this and",
+    "Whoever left",
+    "Hi there! W",
+    "A",
+    "If you have",
+    "I was",
+    "U",
+    "Bless",
+    "Well, this",
+    "Oh, I'",
+    "It's a",
+    "Eww,",
+    "Is everything okay?",
+    "Oh, I",
+    "Hello, can you",
+    "Al",
+    "That was a great",
+    "What are",
+    "I understand that not",
+    "Oh no, not",
+    "Who is it?\"",
+    "Hey, can we",
+    "Whoever is taking",
+    "I would love to",
+    "Hey, I noticed",
+    "Hey, could",
+    "I understand that there",
+    "Hello?",
+    "D",
+    "Oh man, I",
+    "Thank you so much",
+    "Oh no, my",
+    "Dear [Name",
+    "Uh",
+    "I remember",
+    "Hey, who",
+    "Well, it",
+    "Are you",
+    "I understand that it",
+    "Hey, is",
+    "I would",
+    "Who is this",
+    "Excuse me",
+    "Alright",
+    "I am thrilled",
+    "Sometimes friends have",
+    "Who the",
+    "It's interesting",
+    "I would love",
+    "E",
+    "Hello? Is anyone",
+    "Well, this is",
+    "This place",
+    "Well,",
+    "I warned you",
+    "Hey, watch where",
+    "Oh my",
+    "That'",
+    "Sometimes friends have different",
+    "I understand that everyone",
+    "What?",
+    "What do these notes",
+    "I can relate",
+    "I'm not",
+    "I understand",
+    "To my dear",
+    "Guys",
+    "Well",
+    "Hey, I appreciate",
+    "Wow, what",
+    "Dear",
+    "That melody",
+    "Who the hell",
+    "Today is",
+    "Hello little",
+    "Wow, look",
+    "That's great",
+    "Love is never wrong",
+    "I'm having",
+    "Whoa, did",
+    "Ugh",
+    "Can you please provide",
+    "I miss you,",
+    "I feel uncom",
+    "I know",
+    "Ugh, this",
+    "Hey, watch",
+    "Oh great, a",
+    "I didn",
+    "Okay",
+    "That game of char",
+    "Oh",
+    "I appreciate",
+    "Who's there",
+    "I am so",
+    "Oh great, someone",
+    "Hey, could you",
+    "I remember wondering",
+    "Wait, what?",
+    "What do",
+    "Hello? Can",
+    "Hey there,",
+    "That game of",
+    "This is incred",
+    "Oh my gosh",
+    "Oh great, f",
+    "I appreciate your",
+    "It sounds like",
+    "What the heck",
+    "Okay, I understand",
+    "Ew",
+    "I understand that this",
+    "Uh, hi",
+    "Hi everyone!",
+    "What the hell?",
+    "Thank you for your",
+    "Oh no, the",
+    "Wow, I",
+    "Who turned",
+    "Dear [",
+    "Whoever",
+    "This is a",
+    "Whoa, he",
+    "What in the world",
+    "Although the physical",
+    "Hello, who is",
+    "That's amaz",
+    "Hey, I know",
+    "Okay, that",
+    "Hi everyone",
+    "Hey, is everything",
+    "I understand your fr",
+    "Oh no, poor",
+    "Oh, look",
+    "Good morning",
+    "Ew, gross",
+    "Oh no, did",
+    "Look at the family",
+    "Hey team",
+    "Yes!",
+    "Hey, can I",
+    "Okay, that'",
+    "It's great",
+    "Love is",
+    "Hey, what",
+    "Good morning, world",
+    "Who is it?",
+    "That poem really reson",
+    "I",
+    "That's",
+    "I understand the task",
+    "Gu",
+    "Hello? Who'",
+    "This postcard is",
+    "Whoa,",
+    "Oh, that",
+    "I understand that I",
+    "Whoever is",
+    "Hello? Who is",
+    "I'm really",
+    "Wow, this",
+    "Can",
+    "This artwork really",
+    "This is a shame",
+    "I miss you too",
+    "Who are you?",
+    "Today is a difficult",
+    "Hey, just",
+    "Are you okay",
+    "I am",
+    "Hi,",
+    "Wow, that",
+    "Hey there! Can",
+    "Okay, stay",
+    "Oh great, just",
+    "Yeah,",
+    "Hello? Can you",
+    "Oh, looks",
+    "Thank you for sharing",
+    "I'm glad",
+    "Hey, is that",
+    "Hmm",
+    "It was my",
+    "It sounds like you",
+    "Wow, your",
+    "I was promised certain",
+    "That was such a",
+    "Thank",
+    "Excuse you",
+    "That was",
+    "Hey team,",
+    "I feel un",
+    "It was",
+    "What'",
+    "Hey friend, I",
+    "How",
+    "Saying goodbye",
+    "That",
+    "It's heart",
+    "How dare",
+    "Oh,",
+    "Hello, may",
+    "What's this",
+    "Thank you for recogn",
+    "Aww, that",
+    "Oh, I remember",
+    "Hmm, that'",
+    "I miss",
+    "I know this",
+    "Wait",
+    "Is everything okay",
+    "Who is that person",
+    "Wow, you",
+    "Oh great",
+    "I'm sad",
+    "Wow, the",
+    "I am very disappoint",
+    "Who turned off the",
+    "I understand that things",
+    "I'm very",
+    "Hi",
+    "That's very",
+    "Okay, I",
+    "Oh no,",
+    "Wow, there",
+    "What's wrong",
+    "I apologize for",
+    "Hey, I",
+    "Can I help you",
+    "Oh, I didn",
+    "Alright,",
+    "Oh wow,",
+    "Oh my goodness",
+    "I know this event",
+    "What in the",
+    "Saying",
+    "Yeah, that",
+    "Guys, I",
+    "Hey, this v",
+    "This post",
+    "Are",
+    "Hey, can",
+    "Hello? Is",
+    "I can only imagine",
+    "Oh, that sounds",
+    "Hey, is anyone",
+    "I am disappointed",
+    "Hello,",
+    "Hey everyone, I",
+    "That was such",
+    "It's okay",
+    "The artist",
+    "Whoa",
+    "I understand that mistakes",
+    "Can I help",
+    "Who",
+    "Hi everyone! I",
+    "Hey, can you",
+    "Wow, how",
+    "Today",
+    "Oh no, I",
+    "Oh well, I",
+    "Well, that",
+    "This is the",
+    "Yes! I finally",
+    "Hey there little",
+    "Hello everyone!",
+    "Love is never",
+    "Look at the",
+    "This postcard",
+    "Oh great,",
+    "Can I",
+    "Hmm, this is",
+    "I understand your",
+    "Oh, look at",
+    "B",
+    "I'm so",
+    "Whoa, this",
+    "W",
+    "Oh, this",
+    "Sometimes",
+    "This piece of",
+    "What the",
+    "That was a",
+    "Hey, do",
+    "Oh no",
+    "Whoa, what",
+    "I feel like I",
+    "The documentary",
+    "Hello",
+    "Hello little one",
+    "I understand that my",
+    "Eww, that",
+    "Wow, an",
+    "Yes! Finally,",
+    "Although the physical location",
+    "Whoever is watching",
+    "That movie",
+    "I remember wondering about",
+    "Hey there, little",
+    "Who's",
+    "Hello, who",
+    "Hello everyone! Thank",
+    "Hello, can",
+    "That's too",
+    "Hey, just wanted",
+    "Hey there, I",
+    "Saying good",
+    "Hey there!",
+    "Who is there?",
+    "Oh my good",
+    "I am very",
+    "Oh no, what",
+    "Wow, thank",
+    "I was promised",
+    "Hi, is",
+    "Hey, I'",
+    "Guys, the",
+    "Oh no, that",
+    "Who is there",
+    "Hello, this",
+    "That movie really touched",
+    "If you have something",
+    "The documentary was",
+    "I'm starting",
+    "Are you kidd",
+    "That movie really",
+    "Hey everyone,",
+    "Thank you for considering",
+    "I didn'",
+    "Yes! I",
+    "Can you",
+    "Oh my god",
+    "Hey, whoever",
+    "That melody really",
+    "Thank you, little",
+    "Hello, may I",
+    "Look",
+    "Wow, we",
+    "It looks",
+    "What do these",
+    "Oh wow",
+    "I apologize",
+    "What are you all",
+    "It's such",
+    "It's clear",
+    "Hey, I was",
+    "Hey friend,",
+    "I can only",
+    "The weather outside is",
+    "Eww, this",
+    "I miss you",
+    "Wow",
+    "Aww,",
+    "Hi, is there",
+    "This artwork",
+    "Okay,",
+    "Oh well,",
+    "This",
+    "I'",
+    "Say",
+    "Hey there little gu",
+    "Hmm,",
+    "Whoa, who",
+    "I am thr",
+    "Oh man",
+    "Okay, stay calm",
+    "I'm happy",
+    "Oh, this cur",
+    "Oh man,",
+    "I'm sorry",
+    "Hello? Who",
+    "What?! That",
+    "This piece",
+    "Hey everyone",
+    "That's so",
+    "Are you okay?",
+    "What happened? Where",
+    "Hi there",
+    "The",
+    "Who the hell entered",
+    "I can",
+    "Guys,",
+    "What's",
+    "What in",
+    "It's important",
+    "I'm",
+    "I'm coming",
+    "It'",
+    "Yes! Finally",
+    "Wait, what",
+    "Wow, reading",
+    "I'm surprised",
+    "Hey, did",
+    "Hey,",
+    "Okay, let",
+    "I understand that you",
+    "Who the hell threw",
+    "Eww, who",
+    "Thank you for thinking",
+    "Who is this?\"",
+    "I am deeply",
+    "Thank you for including",
+    "Oh no, an",
+    "It looks like you",
+    "Aww",
+    "I'm confused",
+    "Wow, it",
+    "That poem really",
+    "Yes",
+    "Hey there, is",
+    "Hey, what'",
+    "Thank you for remember",
+    "To",
+    "This is",
+    "Thank you for making",
+    "I can'",
+    "That mel",
+    "Wow, they",
+    "I feel like",
+    "Although the",
+    "Who are you",
+    "Love",
+    "If",
+    "What the hell are",
+    "I am so sad",
+    "Oh, I found",
+    "Thank you",
+    "It looks like",
+    "Well, life is",
+    "I appreciate that",
+    "The artist's",
+    "Whoa, that",
+    "It's never"
+  ]

app.py

@@ -13,16 +13,17 @@ import gradio as gr
 from huggingface_hub import login
 
 # Initialize model and tokenizer
-mistral_path = "mistralai/Mistral-7B-Instruct-v0.3"
+llama_path = "meta-llama/Llama-3.2-1B-Instruct"
+#llama_path = r"E:/language_models/models/mistral"
 
-access_token = os.getenv("mistralaccesstoken")
+access_token = os.getenv("llamaaccesstoken")
 login(access_token)
 
-tokenizer = AutoTokenizer.from_pretrained(mistral_path)
+tokenizer = AutoTokenizer.from_pretrained(llama_path)
 tokenizer.pad_token_id = 0
 
 model = AutoModelForCausalLM.from_pretrained(
-    mistral_path,
+    llama_path,
     torch_dtype=torch.float16,
     trust_remote_code=True,
     use_safetensors=True
@@ -33,7 +34,10 @@ model = model.to("cuda:0" if cuda else "cpu")
 if cuda:
     print(f"CUDA device: {torch.cuda.get_device_name(torch.cuda.current_device())}")
     
-model = ControlModel(model, list(range(-5, -18, -1)))
+# in mistral, there are 32 layers from -31 to 0. set to 13 layers from -5 to -18
+# model = ControlModel(model, list(range(-5, -18, -1)))
+# in llama 3.2 there are 32 layers from -16 to 15. set to 13 layers from 11 to -2
+model = ControlModel(model, list(range(14, 1, -1)))
 
 # Generation settings
 # Generation settings
@@ -44,24 +48,25 @@ default_generation_settings = {
     "repetition_penalty": 1.1,              # Reduce repetition
 }
 
-# Tags for prompt formatting
-user_tag, asst_tag = "[INST]", "[/INST]"
+
 
 # List available control vectors
 control_vector_files = [f for f in os.listdir('control_models') if f.endswith('.gguf')]
 
 if not control_vector_files:
-    raise FileNotFoundError("No .gguf control vector files found in the control_models directory.")
+    pass
+    #raise FileNotFoundError("No .gguf control vector files found in the control_models directory.")
 
 # Function to toggle slider visibility based on checkbox state
 def toggle_slider(checked):
     return gr.update(visible=checked)
 
-def construct_prompt(history, system_prompt, user_message):
+def construct_prompt_mistral(history, system_prompt, user_message):
     """
     Converts the history (list of tuples) back into the string format Mistral expects
     """
     formatted_prompt = ""
+    user_tag, asst_tag = "[INST]", "[/INST]"
 
     # <s>[INST] user message[/INST] assistant message</s>[INST] new user message[/INST]
     # Mistral expects the history to be wrapped in <s>history</s>, so it's added here
@@ -86,6 +91,54 @@ def construct_prompt(history, system_prompt, user_message):
     formatted_prompt += f"{user_tag} {user_message} {asst_tag}"
     return formatted_prompt
 
+def construct_prompt_llama(history, system_prompt, user_message):
+    """
+    Converts the history (list of tuples) back into the string format LLama expects
+    LLama prompt format:
+<|begin_of_text|><|start_header_id|>system<|end_header_id|>
+Cutting Knowledge Date: December 2023
+Today Date: 23 July 2024
+You are a helpful assistant
+<|eot_id|>
+<|start_header_id|>user<|end_header_id|>
+What is the capital of France?
+<|eot_id|>
+<|start_header_id|>assistant<|end_header_id|>
+    """
+    formatted_prompt = ""
+
+    # Begin the prompt with the start token
+    formatted_prompt += "<|begin_of_text|>\n"
+
+    # Append the system prompt if provided
+    if system_prompt.strip():
+        formatted_prompt += "<|start_header_id|>system<|end_header_id|>\n"
+        formatted_prompt += f"{system_prompt.strip()}"
+        formatted_prompt += "<|eot_id|>\n"
+
+    # Construct the formatted prompt based on history
+    for user_msg, asst_msg in history:
+        # Append the user message
+        formatted_prompt += "<|start_header_id|>user<|end_header_id|>\n"
+        formatted_prompt += f"{user_msg.strip()}"
+        formatted_prompt += "<|eot_id|>\n"
+
+        # Append the assistant's response
+        formatted_prompt += "<|start_header_id|>assistant<|end_header_id|>\n"
+        formatted_prompt += f"{asst_msg.strip()}"
+        formatted_prompt += "<|eot_id|>\n"
+
+    # Append the new user message
+    formatted_prompt += "<|start_header_id|>user<|end_header_id|>\n"
+    formatted_prompt += f"{user_message.strip()}"
+    formatted_prompt += "<|eot_id|>\n"
+
+    # Indicate that the assistant should provide a response
+    formatted_prompt += "<|start_header_id|>assistant<|end_header_id|>\n"
+
+    return formatted_prompt
+
+
 def generate_response(system_prompt, user_message, history, max_new_tokens, repitition_penalty, do_sample, user_model, input_checkbox, input_slider, *args):
     """
     Applies the control vectors and calls the language model.
@@ -140,7 +193,7 @@ def generate_response(system_prompt, user_message, history, max_new_tokens, repi
     except Exception as e:
         print(f"Failed to set Control: {e}")
 
-    formatted_prompt = construct_prompt(history, system_prompt, user_message)
+    formatted_prompt = construct_prompt_llama(history, system_prompt, user_message)
 
     # Tokenize the input
     input_ids = tokenizer(formatted_prompt, return_tensors="pt").to(model.device)
@@ -186,9 +239,9 @@ def generate_response(system_prompt, user_message, history, max_new_tokens, repi
     # remove the trailing </s> if present
     # it won't be present if the model ran out from max_tokens
     def get_assistant_response(input_string):
-        if len(input_string) >= 4:
-            if input_string[-4:] == "</s>":
-                return input_string[:-4]
+        if len(input_string) >= 10:
+            if input_string[-10:] == "<|eot_id|>":
+                return input_string[:-10]
             else:
                 return input_string
         else:
@@ -361,6 +414,9 @@ def make_dataset(
     suffix_list: list[str]
 ) -> list[DatasetEntry]:
     dataset = []
+    # Tags for prompt formatting with Llama
+    user_tag = "<|start_header_id|>user<|end_header_id|>\n\n"
+    asst_tag = "<|eot_id|>\n<|start_header_id|>assistant<|end_header_id|>"
     for suffix in suffix_list:
         for positive_persona, negative_persona in zip(positive_personas, negative_personas):
             positive_template = template.format(persona=positive_persona)
@@ -386,7 +442,7 @@ def train_model_persona(positive_text, negative_text):
     model.reset()
     output_model = ControlVector.train(model, tokenizer, dataset)
     # Write file to temporary directory returning the path to Gradio for download
-    filename = re.sub(r'[ <>:"/\\|?*]', '', positive_text) + '_'
+    filename = re.sub(r'[ <>:"/\\|?*]', '', positive_list[0]) + '_'
     temp_file = tempfile.NamedTemporaryFile(
         prefix=filename,
         suffix=".gguf",
@@ -405,7 +461,7 @@ def train_model_facts(positive_text, negative_text):
         "Pretend to be a {persona} making statements about the world.",
         positive_text,
         negative_text,
-        fact_suffixes
+        fact_suffixes[0:150]
     )
 
     output_model = ControlVector.train(model, tokenizer, dataset)

true_facts.csv

@@ -0,0 +1,306 @@
+The Earth's atmosphere protects us from harmful radiation from the sun.
+The theory of evolution, proposed by Charles Darwin, states that species evolve over time through natural selection.
+The smallest planet in our solar system is Mercury.
+The moon orbits around the Earth.
+Fire needs oxygen to burn.
+The Statue of Liberty was a gift from France to the United States.
+Comets are icy celestial objects that orbit the Sun.
+Light can exhibit both wave-like and particle-like properties.
+Symbiosis is a close relationship between two species.
+Pizza is a type of food that many people enjoy.
+Sharks are sea creatures that have a reputation for being dangerous.
+The scientific method is a systematic process for investigating phenomena and acquiring new knowledge.
+Plate tectonics shape the Earth's surface.
+The human heart beats approximately 100,000 times per day.
+The color of the sky is blue.
+Cacti store water in their stems.
+The Panama Canal connects the Atlantic and Pacific oceans.
+The three main types of symbiotic relationships are mutualism, commensalism, and parasitism.
+Uranus orbits the Sun on its side.
+The largest continent in the world is Asia.
+The first successful powered flight was made by the Wright Brothers in 1903.
+Jupiter has the Great Red Spot, a giant storm.
+The human eye can detect millions of different colors.
+The three states of matter are solid, liquid, and gas.
+The water cycle includes evaporation, condensation, precipitation, and runoff.
+The planet Uranus is often referred to as the "ice giant."
+The sky is blue.
+The average body temperature of a human is 98.6 degrees Fahrenheit.
+The Earth is round.
+DNA carries genetic information in living organisms.
+The endocrine system regulates body functions through hormones.
+The human body is composed of about 60% water.
+The Great Wall of China is the longest wall in the world.
+The planet Jupiter is the largest planet in our solar system.
+Echoes are sound waves reflecting off surfaces.
+The planet Venus is often referred to as the "morning star" or the "evening star."
+Chemical reactions involve the rearrangement of atoms to form new substances.
+The human brain weighs around 3 pounds.
+The most abundant gas in Earth's atmosphere is nitrogen.
+The highest mountain in North America is Denali.
+The longest river in Europe is the Volga River.
+Osmosis is the movement of water across a selectively permeable membrane.
+The process by which a solid turns directly into a gas, without becoming a liquid, is called sublimation.
+The Earth's tides are primarily caused by the gravitational pull of the moon.
+Mercury is the smallest planet.
+Cows are mammals that produce milk.
+Plants need carbon dioxide to survive.
+The Amazon River is the largest river in the world by volume.
+The immune system defends the body against pathogens.
+There are 118 elements on the periodic table.
+New York City is the largest city in the United States.
+The human brain controls the body's functions.
+Cells are the basic units of life.
+The largest desert in the world is the Sahara Desert.
+Octopuses have three hearts.
+The coldest natural temperature ever recorded was -128.6 degrees Fahrenheit in Antarctica.
+The periodic table organizes elements based on their properties.
+The electron configuration of an atom determines its chemical properties.
+The largest bird in the world is the ostrich.
+Sound travels as a wave through various mediums.
+The three types of blood vessels in the human body are arteries, veins, and capillaries.
+The planet Neptune is named after the Roman god of the sea.
+The highest waterfall in the world is Angel Falls in Venezuela.
+Human digestion begins in the mouth and ends in the small intestine.
+Fish breathe through gills.
+Water freezes at 0 degrees Celsius (32 degrees Fahrenheit).
+The Eiffel Tower is located in Paris, France.
+The Doppler effect causes the change in frequency or wavelength of a wave in relation to an observer.
+Auroras occur near Earth's polar regions.
+The study of heredity and the variation of inherited characteristics is called genetics.
+Polar bears have white fur to camouflage in their snowy environment.
+The planet Saturn has the largest rings in our solar system.
+The human lymphatic system helps fight infections and diseases.
+The Statue of Liberty is located in New York City.
+The process of pollination is crucial for plant reproduction.
+Neptune has the strongest winds in the solar system.
+The Great Barrier Reef is the largest coral reef system in the world.
+Snow is cold.
+Mars has a thin atmosphere.
+Earth has a magnetic field.
+The study of substances and their interactions is called chemistry.
+The Great Barrier Reef is the largest coral reef system in the world.
+A human pregnancy typically lasts around 9 months.
+Coral reefs are made of living organisms.
+The continent of Antarctica is mostly covered in ice.
+An adult human has 32 teeth.
+The tallest mammal in the world is the giraffe.
+Humans have five senses: sight, hearing, touch, taste, and smell.
+The human skin is the body's largest organ.
+Migration allows animals to find better resources.
+The planet Jupiter has the most moons in our solar system.
+The first law of thermodynamics states that energy cannot be created or destroyed, only converted from one form to another.
+Apples are a type of fruit.
+The currency used in Japan is the yen.
+The planet Earth is the only planet known to support life.
+The human eye can distinguish about 10 million different colors.
+The world's largest mammal is the blue whale.
+The Nile River is the longest river in the world.
+Gravity makes things fall down.
+A year on Earth is approximately 365.25 days long, which is why we have a leap year every four years.
+Gravity is the force that attracts objects with mass towards each other.
+The human liver helps filter toxins from the body.
+Bees pollinate approximately one-third of the food we eat.
+The longest highway in the world is the Pan-American Highway.
+The fastest land animal is the cheetah.
+The human immune system helps protect the body from infections.
+Ecosystems consist of living organisms and their physical environment.
+The fastest swimmer in the world is César Cielo from Brazil.
+Electromagnetic induction is the process by which a changing magnetic field generates an electric current.
+Tornadoes are rapidly rotating columns of air.
+The Wright brothers made the first successful airplane flight.
+Neurons are specialized cells that transmit electrical and chemical signals in the nervous system.
+The circulatory system transports nutrients and oxygen throughout the body.
+The Earth has four seasons: spring, summer, fall, and winter.
+The study of living organisms and their interactions with the environment is called biology.
+The distance from the Earth to the sun is approximately 93 million miles.
+Dogs are known for being loyal pets.
+The sky is often cloudy when it's going to rain.
+Ice floats on water due to its lower density.
+The three main types of neurons are sensory neurons, motor neurons, and interneurons.
+The planet Earth is 4.54 billion years old.
+The process of aging is influenced by both genetic and environmental factors.
+Venus has a thick atmosphere.
+The human heart pumps blood throughout the body.
+The carbon cycle maintains the balance of carbon in Earth's atmosphere, oceans, and biosphere.
+The Earth is located in the Milky Way galaxy.
+Stars appear to twinkle due to Earth's atmosphere.
+Cars need gasoline or electricity to run.
+Black holes are regions in space with immense gravitational pull.
+Diamonds are the hardest substance on Earth.
+Vaccines help to prevent infectious diseases.
+The Earth is the third planet from the sun.
+The planet Pluto was reclassified as a dwarf planet in 2006.
+Inertia is an object's resistance to change in motion.
+Earth has one moon.
+Ice cream is a popular dessert.
+The largest country in the world by area is Russia.
+Hybrids are the offspring of two plants or animals from different species or varieties.
+Plants use photosynthesis to create energy from sunlight.
+The largest mammal in the world is the blue whale.
+The human body has 206 bones.
+The planet Mercury is the closest planet to the sun in our solar system.
+The smallest unit of life is the cell.
+The process by which cells divide to form two identical daughter cells is called mitosis.
+The Amazon rainforest is home to immense biodiversity.
+The human respiratory system includes the trachea, bronchi, and lungs.
+Photosynthesis in plants produces oxygen as a byproduct.
+The smallest planet in our solar system is Mercury.
+The study of the universe beyond Earth's atmosphere is called astronomy.
+The human body has 12 pairs of ribs.
+The Earth's ozone layer protects us from harmful ultraviolet (UV) radiation from the sun.
+The first successful vaccine was created by Edward Jenner in 1796.
+Camouflage helps animals blend with their environment.
+Birds can fly.
+The first Olympic Games were held in ancient Greece in 776 B.C.
+Earth is 71% water.
+Polar ice caps are primarily made of fresh water.
+The human nervous system includes the brain, spinal cord, and nerves.
+The scientific name for humans is Homo sapiens.
+Radioactive decay occurs when unstable atomic nuclei release energy in the form of radiation.
+The first animal to orbit Earth was a dog named Laika.
+The color of an object depends on the wavelengths of light that it reflects.
+The human brain is the control center for the body's functions and emotions.
+The two main types of microscopes are light microscopes and electron microscopes.
+The largest mammal on Earth is the blue whale.
+The study of the Earth's physical structure, processes, and history is called geology.
+The speed of light is 299,792,458 meters per second.
+The longest mountain range in the world is the Andes.
+Tornadoes are rapidly rotating columns of air that can cause extensive damage.
+The speed of light is the fastest known speed in the universe.
+The human respiratory system consists of lungs and airways.
+The tallest tree in the world is a redwood tree named Hyperion.
+The planet Venus is the hottest planet in our solar system.
+The human body is approximately 60% water.
+The planet Saturn is named after the Roman god of agriculture.
+The largest country in the world by land area is Russia.
+A group of fish is called a school.
+Our solar system consists of eight planets: Mercury, Venus, Earth, Mars, Jupiter, Saturn, Uranus, and Neptune.
+Superconductors are materials that have no electrical resistance when cooled to certain temperatures.
+Photosynthesis is the process by which plants convert sunlight into chemical energy.
+Ice cream is a popular dessert.
+The process by which a liquid turns into a gas is called evaporation.
+The Roman Empire existed from 27 BC to 476 AD.
+The primary colors of light are red, green, and blue.
+Magnetism is a force that attracts or repels certain materials.
+The study of matter and its interactions with energy is called physics.
+Water is essential for life.
+The planet Pluto has five known moons.
+The scientific method is a process for testing hypotheses and acquiring knowledge.
+The greenhouse effect helps regulate Earth's temperature.
+Fossils are the preserved remains or traces of organisms that lived in the past.
+Tides are caused by the gravitational interactions between the Earth, Moon, and Sun.
+The planet Mars has the largest volcano in our solar system.
+The process by which plants release oxygen and absorb carbon dioxide is called respiration.
+The highest point in Africa is Mount Kilimanjaro.
+Metamorphosis is a biological process in which an organism undergoes a significant change in form during its life cycle.
+The boiling point of water decreases as altitude increases.
+The speed of light is approximately 299,792,458 meters per second.
+Rainbows form when light refracts through water droplets.
+Jupiter is mostly made of hydrogen and helium.
+The shortest month of the year is February.
+Volcanoes form at areas where Earth's tectonic plates interact.
+The three main types of chemical bonds are ionic, covalent, and metallic.
+The respiratory system allows for the exchange of gases between the body and the environment.
+Humans have five basic senses.
+Honey is produced by bees.
+A group of wolves is called a pack.
+The human body is made up of bones, muscles, and organs.
+Sound travels through the air as vibrations.
+The Earth's rotation on its axis causes day and night.
+The sun is a star.
+The currency of Japan is the yen.
+Antibiotics are used to treat bacterial infections.
+The Great Wall of China is the longest wall in the world.
+Iron rusts in the presence of oxygen and water.
+Mars has the largest volcano, Olympus Mons.
+Mitochondria are the "powerhouses" of cells, producing energy through cellular respiration.
+The alphabet consists of 26 letters.
+The Krebs cycle is a series of chemical reactions that generate energy in cells.
+Diamonds are made of carbon.
+The human body has 206 bones.
+The auroras, or polar lights, are natural light displays caused by the interaction of solar particles with Earth's magnetic field.
+The human digestive system breaks down food into nutrients.
+The Sahara is the largest hot desert.
+Lightning is a discharge of static electricity.
+Humans need air, water, and food to survive.
+The two main types of cells are prokaryotic (without a nucleus) and eukaryotic (with a nucleus).
+Oxygen is necessary for humans to breathe.
+Elephants are the largest land animals on Earth.
+Diamonds are formed from carbon.
+Seasons are caused by Earth's tilt.
+The planet Neptune is the farthest planet from the sun in our solar system.
+The human circulatory system is a closed system consisting of the heart, blood vessels, and blood.
+The Earth's atmosphere is composed mostly of nitrogen and oxygen.
+A group of lions is called a pride.
+Evolution occurs through the process of natural selection.
+Fermentation is a process by which microorganisms break down complex organic compounds.
+Fossils provide evidence of past life on Earth.
+Friction is the force that resists motion between two surfaces in contact.
+The Pacific Ocean is the largest ocean in the world.
+Mount Everest is the highest mountain in the world.
+The oldest known human fossils are around 300,000 years old.
+The capital of the United States is Washington, D.C.
+Oxygen is essential for human life.
+Oxygen is essential for respiration.
+The Titanic was a famous ship that sank in 1912.
+The atomic number of an element represents the number of protons in its nucleus.
+Hibernation conserves energy during cold periods.
+Rainbows are formed when light is refracted through water droplets in the air.
+The human muscular system allows us to move and lift things.
+The Sun is a star.
+The Earth is round.
+The Earth's magnetic field is what causes compasses to point north.
+The Coriolis effect influences the movement of large-scale weather systems.
+Sound travels faster through solids than through liquids or gases.
+The first successful human heart transplant was performed in 1967.
+The planet Mars is known as the "Red Planet" due to its reddish appearance.
+Electromagnetic waves include radio waves, microwaves, infrared, visible light, ultraviolet, X-rays, and gamma rays.
+Earthquakes are caused by the movement of tectonic plates.
+The Earth orbits the Sun.
+Water freezes at 0 degrees Celsius (32 degrees Fahrenheit) and boils at 100 degrees Celsius (212 degrees Fahrenheit).
+The pH scale measures the acidity or alkalinity of a substance, ranging from 0 (most acidic) to 14 (most alkaline), with 7 being neutral.
+The human reproductive system includes the ovaries, uterus, and testes.
+The Hubble Space Telescope has provided valuable information about distant celestial objects.
+The planet Uranus is tilted on its side.
+The sun rises in the east and sets in the west.
+A substance that cannot be broken down into simpler substances by chemical means is called an element.
+The human skeleton provides support and protection for the body.
+Saturn has thousands of rings.
+The conservation of energy principle states that energy cannot be created or destroyed.
+Sound travels through the air as waves.
+Saturn's largest moon is Titan.
+Light travels faster than sound.
+The Earth has one moon.
+Venus is similar in size to Earth.
+Birds have feathers and wings.
+The Milky Way is a spiral galaxy.
+The Great Sphinx of Giza is an ancient statue in Egypt.
+The human endocrine system produces hormones that regulate various bodily functions.
+Lava is molten rock from volcanoes.
+The Sahara Desert is the largest hot desert in the world.
+Water is wet.
+The human urinary system helps remove waste products from the body.
+Sunflowers follow the movement of the sun across the sky.
+Mercury has no moons.
+The human liver can regenerate itself up to 75%.
+Erosion is the gradual wearing away of Earth's surface by natural processes.
+The Earth's largest ocean is the Pacific Ocean.
+Volcanic eruptions can create new land.
+The three types of rocks are igneous, sedimentary, and metamorphic.
+Gravity pulls objects towards each other.
+The sun rises in the east and sets in the west.
+The human body has 206 bones.
+The smallest continent in the world is Australia.
+Trees absorb carbon dioxide and release oxygen.
+The tallest building in the world is the Burj Khalifa in Dubai.
+Butterflies go through a process called metamorphosis.
+The planet Mars is named after the Roman god of war.
+The largest ocean in the world is the Pacific Ocean.
+The Mona Lisa is a famous painting by Leonardo da Vinci.
+The first Olympic Games were held in ancient Greece in 776 BC.
+Atoms are the basic building blocks of matter.
+The four fundamental forces of nature are gravity, electromagnetism, the strong nuclear force, and the weak nuclear force.
+The human body has four types of blood groups: A, B, AB, and O.
+Convection is the transfer of heat through the movement of fluids or gases.
+The human body has more than 600 muscles.