Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
e34f8a5
Integración de ArticleViewSet en el enrutador y actualización de URLs…
eduranm Sep 26, 2025
ab31a5e
Actualización de settings: cambio en directorio de modelos, inclusión…
eduranm Sep 26, 2025
b2e9538
Ampliación de core.models: nuevos modelos de género, idioma, licencia…
eduranm Sep 26, 2025
d7395d9
Actualización en Reference: uso de ReferenceStatus y ajuste en creaci…
eduranm Sep 26, 2025
02654a5
Refactor en reference.config: serialización de ejemplos con json.dump…
eduranm Sep 26, 2025
e40b6be
Refactor en marker: actualización de importación de GenericLlama desd…
eduranm Sep 26, 2025
d88c9c5
Eliminación de reference.tasks (responsabilidad movida a data_utils y…
eduranm Sep 26, 2025
3159c3b
Refactor en wagtail_hooks: uso de SnippetViewSet y soporte para desca…
eduranm Sep 26, 2025
8746d02
Actualización de dependencias: inclusión de langid, google-generative…
eduranm Sep 26, 2025
a9305e6
Creación y ampliación de la app core: modelos comunes, formularios, v…
eduranm Sep 26, 2025
95a8153
Nueva app markup_doc: modelos ArticleDocx, API REST, tareas de marcad…
eduranm Sep 26, 2025
58cc438
Nueva librería markuplib: funciones para procesar DOCX y transformaci…
eduranm Sep 26, 2025
4944e3b
Nueva app model_ai: integración de LLaMA, funciones genéricas, mensaj…
eduranm Sep 26, 2025
4ecb50a
Módulos adicionales en reference: configuración de Gemini y utilidade…
eduranm Sep 26, 2025
2ab9bd9
Consolidación de migraciones en reference: actualización de 0001_init…
eduranm Sep 26, 2025
3024568
Actualización de migración inicial en core_settings: cambio de versió…
eduranm Sep 26, 2025
1e31de7
Creación de migración inicial en core
eduranm Sep 26, 2025
826800b
Eliminación de la app llama3: funcionalidades migradas a model_ai
eduranm Sep 26, 2025
76258cd
fix(markup_doc): capturar ArticleDocxMarkup.DoesNotExist en generate_xml
eduranm Oct 5, 2025
aff3a39
refactor(markuplib): eliminar prints de depuración en extracción de e…
eduranm Oct 5, 2025
6dd1ae2
style(model_ai): reemplazar bare except por Exception en download_model
eduranm Oct 5, 2025
5842054
fix(reference): corregir literales y separadores en config_gemini par…
eduranm Oct 5, 2025
6a09911
i18n(reference): envolver labels y help_text con gettext_lazy
eduranm Oct 5, 2025
95e6d31
model_ai: corrige etiqueta de i18n y refuerza unicidad de LlamaModel …
eduranm Oct 17, 2025
192403d
reference: renombra campo 'estatus' a 'status' y ajusta etiqueta a 'R…
eduranm Oct 17, 2025
22fe3d1
reference: elimina import no utilizado en wagtail_hooks.py
eduranm Oct 17, 2025
abe54e2
remove antigo app llama3 e resolve conflito em base.py
pitangainnovare Oct 20, 2025
e000258
adiciona instruções para fazer build com suporte a Llama
pitangainnovare Oct 20, 2025
cbc8509
melhora imports
pitangainnovare Oct 20, 2025
2c32138
Apaga modulo legado llama3
pitangainnovare Oct 20, 2025
aa9c6a3
Resolve conflitos em generic_llama e aplica correções estruturais:
pitangainnovare Oct 20, 2025
dc61b24
Cria input settings para references
pitangainnovare Oct 20, 2025
e2e696a
Padroniza deps
pitangainnovare Oct 20, 2025
3e712af
Padroniza imports em geral (além de adequar à nova nomenclatura)
pitangainnovare Oct 20, 2025
dd94a35
Adiciona método faltante em marker (por causa de merge)
pitangainnovare Oct 20, 2025
3ed8e58
Remove linhas comentadas
pitangainnovare Oct 20, 2025
1fbd7d1
Inclui AI Model na interace, para poder registrar modelos
pitangainnovare Oct 20, 2025
e22bc7c
Adequa uso do serviço Llama em tasks
pitangainnovare Oct 20, 2025
79245bd
Adiciona migrações
pitangainnovare Oct 20, 2025
5740120
Corrige nome de parâmetro type (deve ser mode)
pitangainnovare Oct 20, 2025
a830fb5
Flexibiliza attrs de LlamaService
pitangainnovare Oct 20, 2025
3bf5c7c
Adiciona alguns FIXME
pitangainnovare Oct 20, 2025
f501379
Melhora imports
pitangainnovare Oct 20, 2025
cb739b4
Padroniza nome de metodo que obtem tipo de IA (LLAMA ou GEMINI)
pitangainnovare Oct 20, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 7 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,7 @@ Targets:
vcs_ref Show last commit ref
build_date Show build date
build Build app using $(COMPOSE_FILE_DEV)
build_llama Build app using llama.local.yml
up Start app using $(COMPOSE_FILE_DEV)
logs Show logs using $(COMPOSE_FILE_DEV)
stop Stop app using $(COMPOSE_FILE_DEV)
Expand All @@ -58,14 +59,19 @@ Targets:

### Common Commands

Build the development environment:
Build the development environment without Llama support:

```bash
make build compose=local.yml
# or simply
make
```

Build the development environment with Llama support:
```bash
make build compose=llama.local.yml
```

Start the project:

```bash
Expand Down
4 changes: 3 additions & 1 deletion config/api_router.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,14 +2,16 @@
from rest_framework.routers import DefaultRouter, SimpleRouter

from reference.api.v1.views import ReferenceViewSet
from markup_doc.api.v1.views import ArticleViewSet

app_name = "reference"
#app_name = "reference"

if settings.DEBUG:
router = DefaultRouter()
else:
router = SimpleRouter()

router.register("reference", ReferenceViewSet, basename="reference")
router.register("first_block", ArticleViewSet, basename="first_block")

urlpatterns = router.urls
10 changes: 8 additions & 2 deletions config/settings/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@
ROOT_DIR = Path(__file__).resolve(strict=True).parent.parent.parent
# core/
APPS_DIR = ROOT_DIR / "core"
LLAMA_MODEL_DIR = ROOT_DIR / "model_ai/download"

env = environ.Env()
READ_DOT_ENV_FILE = env.bool("DJANGO_READ_DOT_ENV_FILE", default=False)
Expand Down Expand Up @@ -80,6 +81,9 @@
"tracker",
"reference",
"xml_manager",
"markup_doc",
"markuplib",
"model_ai"
]

INSTALLED_APPS = DJANGO_APPS + THIRD_PARTY_APPS + LOCAL_APPS + WAGTAIL
Expand Down Expand Up @@ -296,5 +300,7 @@

# LLAMA
LLAMA_ENABLED = env.bool("LLAMA_ENABLED", default=False)
LLAMA_MODEL_DIR = ROOT_DIR / "llama3/llama-3.2"
MODEL_LLAMA = "llama-3.2-3b-instruct-q4_k_m.gguf"
MODEL_LLAMA = "llama-3.2-3b-instruct-q4_k_m.gguf"

#Aumento en el límite de campos
DATA_UPLOAD_MAX_NUMBER_FIELDS = 10000
7 changes: 5 additions & 2 deletions config/urls.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,23 +11,26 @@

from core.search import views as search_views
from reference import views as reference_views
from config import api_router as api_router

urlpatterns = [
path("admin/autocomplete/", include(autocomplete_admin_urls)),
#path("admin/autocomplete/", include(autocomplete_admin_urls)),
path("django-admin/", admin.site.urls),
path("admin/", include(wagtailadmin_urls)),
path("documents/", include(wagtaildocs_urls)),
path("search/", search_views.search, name="search"),
# JWT
path("api/v1/auth/token/", TokenObtainPairView.as_view(), name="token_obtain_pair"),
path("api/v1/auth/token/refresh/", TokenRefreshView.as_view(), name="token_refresh"),
path("api/v1/mix_citation/", include("config.api_router", namespace="reference")),
path("api/v1/", include(api_router)),
#path("api/v1/mix_citation/", include("config.api_router", namespace="reference")),
# URL para trocar idioma
path('i18n/', include('django.conf.urls.i18n')),
] + static(settings.MEDIA_URL, document_root=settings.MEDIA_ROOT)

# URLs com prefixo de idioma
urlpatterns += i18n_patterns(
path("admin/autocomplete/", include(autocomplete_admin_urls)),
path("admin/", include(wagtailadmin_urls)),
path("documents/", include(wagtaildocs_urls)),
path("search/", search_views.search, name="search"),
Expand Down
227 changes: 227 additions & 0 deletions core/choices.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,227 @@
from django.utils.translation import gettext_lazy as _

LANGUAGE = [
("aa", "Afar"),
("af", "Afrikaans"),
("ak", "Akan"),
("sq", "Albanian"),
("am", "Amharic"),
("ar", "Arabic"),
("an", "Aragonese"),
("hy", "Armenian"),
("as", "Assamese"),
("av", "Avaric"),
("ae", "Avestan"),
("ay", "Aymara"),
("az", "Azerbaijani"),
("bm", "Bambara"),
("ba", "Bashkir"),
("eu", "Basque"),
("be", "Belarusian"),
("bn", "Bengali"),
("bi", "Bislama"),
("bs", "Bosnian"),
("br", "Breton"),
("bg", "Bulgarian"),
("my", "Burmese"),
("ca", "Catalan, Valencian"),
("ch", "Chamorro"),
("ce", "Chechen"),
("ny", "Chichewa, Chewa, Nyanja"),
("zh", "Chinese"),
(
"cu",
"Church Slavic, Old Slavonic, Church Slavonic, Old Bulgarian, Old Church Slavonic",
),
("cv", "Chuvash"),
("kw", "Cornish"),
("co", "Corsican"),
("cr", "Cree"),
("hr", "Croatian"),
("cs", "Czech"),
("da", "Danish"),
("dv", "Divehi, Dhivehi, Maldivian"),
("nl", "Dutch, Flemish"),
("dz", "Dzongkha"),
("en", "English"),
("eo", "Esperanto"),
("et", "Estonian"),
("ee", "Ewe"),
("fo", "Faroese"),
("fj", "Fijian"),
("fi", "Finnish"),
("fr", "French"),
("fy", "Western Frisian"),
("ff", "Fulah"),
("gd", "Gaelic, Scottish Gaelic"),
("gl", "Galician"),
("lg", "Ganda"),
("ka", "Georgian"),
("de", "German"),
("el", "Greek, Modern (1453–)"),
("kl", "Kalaallisut, Greenlandic"),
("gn", "Guarani"),
("gu", "Gujarati"),
("ht", "Haitian, Haitian Creole"),
("ha", "Hausa"),
("he", "Hebrew"),
("hz", "Herero"),
("hi", "Hindi"),
("ho", "Hiri Motu"),
("hu", "Hungarian"),
("is", "Icelandic"),
("io", "Ido"),
("ig", "Igbo"),
("id", "Indonesian"),
("ia", "Interlingua (International Auxiliary Language Association)"),
("ie", "Interlingue, Occidental"),
("iu", "Inuktitut"),
("ik", "Inupiaq"),
("ga", "Irish"),
("it", "Italian"),
("ja", "Japanese"),
("jv", "Javanese"),
("kn", "Kannada"),
("kr", "Kanuri"),
("ks", "Kashmiri"),
("kk", "Kazakh"),
("km", "Central Khmer"),
("ki", "Kikuyu, Gikuyu"),
("rw", "Kinyarwanda"),
("ky", "Kirghiz, Kyrgyz"),
("kv", "Komi"),
("kg", "Kongo"),
("ko", "Korean"),
("kj", "Kuanyama, Kwanyama"),
("ku", "Kurdish"),
("lo", "Lao"),
("la", "Latin"),
("lv", "Latvian"),
("li", "Limburgan, Limburger, Limburgish"),
("ln", "Lingala"),
("lt", "Lithuanian"),
("lu", "Luba-Katanga"),
("lb", "Luxembourgish, Letzeburgesch"),
("mk", "Macedonian"),
("mg", "Malagasy"),
("ms", "Malay"),
("ml", "Malayalam"),
("mt", "Maltese"),
("gv", "Manx"),
("mi", "Maori"),
("mr", "Marathi"),
("mh", "Marshallese"),
("mn", "Mongolian"),
("na", "Nauru"),
("nv", "Navajo, Navaho"),
("nd", "North Ndebele"),
("nr", "South Ndebele"),
("ng", "Ndonga"),
("ne", "Nepali"),
("no", "Norwegian"),
("nb", "Norwegian Bokmål"),
("nn", "Norwegian Nynorsk"),
("ii", "Sichuan Yi, Nuosu"),
("oc", "Occitan"),
("oj", "Ojibwa"),
("or", "Oriya"),
("om", "Oromo"),
("os", "Ossetian, Ossetic"),
("pi", "Pali"),
("ps", "Pashto, Pushto"),
("fa", "Persian"),
("pl", "Polish"),
("pt", "Português"),
("pa", "Punjabi, Panjabi"),
("qu", "Quechua"),
("ro", "Romanian, Moldavian, Moldovan"),
("rm", "Romansh"),
("rn", "Rundi"),
("ru", "Russian"),
("se", "Northern Sami"),
("sm", "Samoan"),
("sg", "Sango"),
("sa", "Sanskrit"),
("sc", "Sardinian"),
("sr", "Serbian"),
("sn", "Shona"),
("sd", "Sindhi"),
("si", "Sinhala, Sinhalese"),
("sk", "Slovak"),
("sl", "Slovenian"),
("so", "Somali"),
("st", "Southern Sotho"),
("es", "Español"),
("su", "Sundanese"),
("sw", "Swahili"),
("ss", "Swati"),
("sv", "Swedish"),
("tl", "Tagalog"),
("ty", "Tahitian"),
("tg", "Tajik"),
("ta", "Tamil"),
("tt", "Tatar"),
("te", "Telugu"),
("th", "Thai"),
("bo", "Tibetan"),
("ti", "Tigrinya"),
("to", "Tonga (Tonga Islands)"),
("ts", "Tsonga"),
("tn", "Tswana"),
("tr", "Turkish"),
("tk", "Turkmen"),
("tw", "Twi"),
("ug", "Uighur, Uyghur"),
("uk", "Ukrainian"),
("ur", "Urdu"),
("uz", "Uzbek"),
("ve", "Venda"),
("vi", "Vietnamese"),
("vo", "Volapük"),
("wa", "Walloon"),
("cy", "Welsh"),
("wo", "Wolof"),
("xh", "Xhosa"),
("yi", "Yiddish"),
("yo", "Yoruba"),
("za", "Zhuang, Chuang"),
("zu", "Zulu"),
]

ROLE = [
("Editor-Chefe", _("Editor-Chefe")),
("Editor(es) Executivo", _("Editor(es) Executivo")),
("Editor(es) Associados ou de Seção", _("Editor(es) Associados ou de Seção")),
("Equipe Técnica", _("Equipe Técnica")),
]

MONTHS = [
("01", _("January")),
("02", _("February")),
("03", _("March")),
("04", _("April")),
("05", _("May")),
("06", _("June")),
("07", _("July")),
("08", _("August")),
("09", _("September")),
("10", _("October")),
("11", _("November")),
("12", _("December")),
]

# https://creativecommons.org/share-your-work/cclicenses/
# There are six different license types, listed from most to least permissive here:
LICENSE_TYPES = [
("by", _("by")),
("by-sa", _("by-sa")),
("by-nc", _("by-nc")),
("by-nc-sa", _("by-nc-sa")),
("by-nd", _("by-nd")),
("by-nc-nd", _("by-nc-nd")),
]

GENDER_CHOICES = [
('M', _('Male')),
('F', _('Female')),
]
Loading
Loading