This is my first time running LLM locally. I am running TheBloke/SUS-Chat-34B-AWQ using text-generation-webui.
On my simple prompt "Write a story about a village boy" output from LLM is not making any sense". I have tried changing various parameters and tried choosing different parameter presets but it makes no difference. I don't understand reason.
1) Because I am running a scaled down AWQ version?
2) Parameters needs improvement?
3) I should choose another model?
4) Current open source models are like this and need improvement?
My hardware: RTX 4090. 32 core CPU with 128G RAM.
Any recommendations?
Output: "Once upon a time in a small village nestled among rolling hills lived a young boy named Jack who loved nothing more than exploring his surroundings on foot or by bicycle which he had received as gift from one of his friends for occasion marking end summer season before start school year when all children were required attend classes every day Monday through Friday except holidays Thanksgiving Day Christmas Eve New Year's Day Memorial Day Labor Day Columbus Day Veterans Day Presidents Day Martin Luther King Jr. Day Juneteenth Independence Day Fourth July Flag Day National Anthem Day Constitution Day Bill Rights Day Declaration Independence Day Federal Holiday State Local Government Public Schools Colleges Universities Libraries Museums Galleries Exhibitions Festivals Parades Concerts Performances Plays Musicals Operas Ballet Dance Theater Drama Comedy Tragedy Satire Irony Paradox Riddle Puzzle Enigma Mystery Question Answer Solution Recommendation Decision Making Problem Solving Critical Thinking Analytical Reasoning Logical Deductive Inductive Hypothetical Speculative Imaginative Creative Innovative Original Unique Unusual Exceptional Outstanding Remarkable Extraordinary Superlative Supreme Ultimate Final End Conclusion Summary Recap Review Critique Commentary Analysis Synthesis Evaluation Appraisal Assessment Examination Test Quiz Survey Poll Ballot Voting Election Campaign Candidate Platform Policy Proposal Initiative Referendum Recall Redress Reparation Compensation Restitution Reimbursement Remuneration Wages Salaries Bonuses Commissions Percentage Interest Rate Currency Exchange Market Economy Business Industry Sector Trade Commerce Finance Accounting Auditing Taxes Revenue Income Expenses Costs Benefits Advantages Disadvantages Drawbacks Limitations Constraints Barriers Obstacles Impediments Hindrances Retardations Delay Postponement Suspension Interruption Break Stop Cease Halt Arrest Detain Incarcerate Jail Penitentiary Correction Facility Institution Organization Group Team Squad Unit Department Division Section Part Whole Entire Complete Finished Unfinished Incomplete Unsuccessful Failed Failing Failure Mistake Error Blunder Slip Trip Fall Drop Lose Loss Damage Destruction Ruins Debris Ashes Embers Flames Fire Smoke Gas Air Water Sea Ocean River Stream Brook Creek Pond Lake Reservoir Dam Canal Lock Weir Jetty Pier Wharf Dock Harbor Marina Yacht Club Boating Sailing Cruising Racing Regatta Tournament Championship Cup Trophy Medal Ribbon Banner Pennant Flag Colors Symbol Sign Meaning Interpretation Translation Transliteration Idiom Phrase Sentence Clause Proposition Statement Fact Information Knowledge Wisdom Insight Understanding"
