Skip to content

Fix/local models#30

Open
moro-no-kimi wants to merge 6 commits into
shubham0204:mainfrom
moro-no-kimi:fix/local-models
Open

Fix/local models#30
moro-no-kimi wants to merge 6 commits into
shubham0204:mainfrom
moro-no-kimi:fix/local-models

Conversation

@moro-no-kimi

@moro-no-kimi moro-no-kimi commented Dec 28, 2025

Copy link
Copy Markdown

I noticed that the Qwen and Phi models weren't working because the app was forcing use of a Gemini API key. This allows for those models to be used without entering a key. Also added DeepSeek R1 and Qwen3-4b

Comment thread gradle.properties
# thereby reducing the size of the R class for that library
android.nonTransitiveRClass=true No newline at end of file
android.nonTransitiveRClass=true
# Use Java 21

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any specific reason we are upgrading to Java 21? Also, to upgrade the JDK used to compile the app's source code, we modify the below options in app/build.gradle.kts:

compileOptions {                                  
    sourceCompatibility = JavaVersion.VERSION_17 
    targetCompatibility = JavaVersion.VERSION_17 
}                                                
kotlinOptions {                                  
    jvmTarget = "17"                             
}                                                

Comment thread .gitignore

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As no new types of files have been included in the project, I would prefer sticking to the existing .gitignore. If there comes a new file that has to be excluded from VCS, we simply add a new exclusion to .gitignore.

name = "Qwen2.5 3B Instruct Q8",
description = "A Qwen family model series",
downloadUrl = "https://huggingface.co/litert-community/Qwen2.5-3B-Instruct/resolve/main/Qwen2.5-3B-Instruct_multi-prefill-seq_q8_ekv1280.task",
name = "Qwen3 4B Thinking Q4",

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to keep Qwen2.5 3B Instruct Q8 and add Qwen3 4B Thinking Q4? You may add the link to an un-guarded Qwen 2.5 3B LiteRT model file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants