QNS-2-ReLearn-Preview

These models are used to summarize text for training data for smaller models. This is in preview; data generated by this model may require review by a human.

benchmarks will be released in a few days/weeks

IMPORTANT NOTE: Languages besides English are experimental! The model's performance may be unstable below q8. I recommend using BF16 for multilingual heavy data.

Structure of generated text

QNS models follow a very specific structure. The benefit from this is that the text can be displayed in creative ways in an in-app UI.

Example text generated about photosynthesis:

<s> Photosynthesis is the fundamental biological process that captures solar energy to produce chemical energy, forming the basis of food chains, atmospheric stability, and global carbon cycling.</s>

Then, after this, the model will create the proper summary:

### The Process of Photosynthesis
- Photosynthesis is the primary mechanism by which energy from the Sun is captured and transformed into chemical energy stored in glucose.
- It occurs in plant cells within specialized organelles called chloroplasts, utilizing pigments like chlorophyll to absorb light energy.
- The process involves two major stages: light-dependent reactions and light-independent reactions (Calvin Cycle).
    - Light-dependent reactions occur in the thylakoid membranes, generating ATP and NADPH while splitting water molecules.
    - Light-independent reactions (Calvin Cycle) use ATP and NADPH to fix carbon dioxide into glucose.
- Photosynthesis requires raw materials such as carbon dioxide, water, and sunlight, and involves the coordinated movement of these substances within the plant.

### Mechanisms and Factors
- **Light Dependent Reactions:**
    - Light energy excites electrons in chlorophyll, initiating a chain of reactions that produce ATP and NADPH.
    - Water molecules are split (photolysis), releasing oxygen as a byproduct.
- **Light Independent Reactions (Calvin Cycle):**
    - These reactions occur in the stroma and depend on ATP and NADPH from the light reactions.
    - Carbon dioxide is incorporated into organic molecules to synthesize glucose and other carbohydrates.
- **Environmental Influences:**
    - **Light Intensity:** Limits the energy available; saturation occurs at high light levels.
    - **Temperature:** Enzymes involved in photosynthesis are sensitive; extreme temperatures can denature them.
    - **Carbon Dioxide Concentration:** Higher concentrations generally enhance photosynthetic rates up to a threshold.
    - **Water Availability:** Essential for stomatal opening; shortages cause stomata to close, limiting carbon dioxide uptake.
- **Ecological and Evolutionary Importance:**
    - Photosynthesis is the foundation of nearly all food chains, providing energy for herbivores and carnivores.
    - It plays a critical role in climate regulation by absorbing atmospheric carbon dioxide.
    - Evolutionary adaptations, such as C4 and CAM photosynthesis, demonstrate the flexibility of photosynthetic pathways in response to environmental pressures.

The response is very predictable, making it suitable for apps that require summaries. I recommend using QNS-2-preview if you want to do an in-app inference.

Note:

Sometimes, the model tends to be chatty or unpredictable. I will fix that in the proper release of the model. Use this model to mass produce data to make training data. I will fix this with a proper human selected dataset, and DPO.