Skip to content

⭐ Datatensor V1 ⭐ #44

Open
RuellePaul wants to merge 87 commits intomasterfrom
dev
Open

⭐ Datatensor V1 ⭐ #44
RuellePaul wants to merge 87 commits intomasterfrom
dev

Conversation

@RuellePaul
Copy link
Copy Markdown
Owner

@RuellePaul RuellePaul commented Jun 14, 2021

Here is the progression of the entire code of Datatensor.

RuellePaul and others added 30 commits January 14, 2021 20:23
* WIP front end setup

* WIP Setup front end react/typescript

* Lint

* Lint

* Remove useless code

* Add node server middleware, fake HTTPS

* meta stuff

* Add antd lib

* update gitignore

* add README.md skeleton

* typo

* add node sass

* add polyfills

* Add router dom and history

* meta

* meta

* WIP Layout

* Cleaning

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* switch js to tsx

* add api minimal code from epv2

* working api, some front refactors

* add some oauth backend (authorization endpoint)

* add stackoverflow website for oauth2 login

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* update favicon

* add logo

* achieve components hierarchy

* put Login as component in Home view

* Add hook useLoading

* split again, add helmet

* WIP Header

* Add theme

* WIP Login design

* Add Fallback properly

* add icon history push

* WIP OAuthCallback.tsx

* Complete oauth workflows to fetch user info

* add Form component

* add Text component, fixes

* wip refactor back auth

* wip refactor back auth 2

* adjustments

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* fix

* convert tsx to ts where there is no need for JSX

* wip working on Top bar user account

* adjustments

* cleaning

* WIP Menu design for Account.tsx

* Fancy stuff, enhance menu

* Add menu link

* Add logout

* WIP Menu design

* fix

* fix

* add link for `forgot password` and `register`

* add ForgotPassword and Register skeletons

* Add Register front end, and Inputs.Captcha

* fix tpyo

* last front end adjustments for authentification

* backend refactoring

* backend refactoring

* wip regular login (front + back)

* add Register backend

* cleaning

* renaming

* fixes

* security : wip access token. pass it when login / register to front end via cookie `access_token`; re-sent to back using headers `Authorization`. !! No refresh yet, no clear cookie

* security : wip access token. add logout mechanism

* security : add authenticated prop on Route

* Routing rules

* 2h session

* use pymongo crypt field on name, email, password

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* wip design settings

* wip

* wip

* fix

* WIP settings ! :(

* WIP settings Appearance and Profile

* fix settings issue

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* drawer creation
add creation_dataset route

* end dataset creation. front end skeleton

* WIP Dataset design

* WIP Dataset design

* :D

* fixes

* fix

* misc

* front end skeleton

* commit yarn.lock

* huge lint

* fixes

* ux architecture simplified

* commit yarn.lock

* fix

* fix

* WIP front end

* wip refactoring to call current backend (at this point, deleting `import 'src/__mocks__';` will result to call API !)

* finally manage to link Flask API !

* WIP huge refactoring work

* fix

* remove useless code

* add google recaptcha on register flow

* fix

* fix

* IT'S ALIVE

* add REACT_APP_IS_MOCK_ACTIVE

* done OAuth :D

* add dotenv

* admin users

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* Deplomynet | Try 1

* Deplomynet | Try 2

* Deplomynet | Try 3

* Create Make_ui_image_preproduction.yml

* Create Make_api_image.yml

* fix workflow ui -> ux

* fix docker compose

* Revert "fix docker compose"

This reverts commit ae47913.

* fix docker compose

* fix docker compose

* fix docker compose

* Update Make_api_image.yml

* Update Make_ui_image_preproduction.yml

* fix dockerfile ui -> ux

* git push

* add thomas in admin

* wip users list

* wip users list

* fixes

* add `createdAt` key (front + back)

* Rename product -> dataset

* add new blueprint manage

* fix typo

* add create_dataset route

* rename 'files' in 'images'

* rename 'files' in 'images'

* change type bitches

* change type bitches

* add datasets fetch route

* admin guard, fetch datasets admin protected, ip front end user details

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* remove useless key

* remove sensitive init env vars

* WIP cleaning front end. Add `is_admin` key on users

* Admin tabs are now not visible for not admin users!

* fix sort for user list

* WIP front end fixes and adjustments. Split correctly admin routes / user route. Delete propTypes.

* Start dataset front end !

* fix

* WIP infra | DTServerTest

* Create Make_ui_image_test.yml

* Delete Make_ui_image_preproduction.yml

* Update and rename Make_ui_image_test.yml to Make_ux_image_test.yml

* WIP deployment DTServerTest procedure

* add docker login procedure

* cleaning

* add serve in pck.json

* clean before paul... lol

* fix

* fix

* fix

* fix config `DB_HOST`

* fix config `ADMIN_USER_IDS`

* hard cleaning

* hard cleaning

* update api/requirements.txt

* typo

* fix

* fix

* fix

* fix

* update recpatcha v2

* fix jwt lib

* deployment in README.md

* microfix

* ahah

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* add UsersOverTime(wip)

* end users over time !

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* enhance code quality for user over time chart. convert to bar chart

* fix redirection

* fix little design issues

* lint

* update infrastructure

* fix

* oups

* fix

* lint

* fix caching

* fix

* test

* test

* test

* test

* wip certificates nightmare

* well known issue

* well known issue again

* fix uri

* remove prod serv

* wip

* edit stackoverflow oauth config

* fix

* fix csrf

* fix

* fix

* wipp

* wipp

* fix

* cool details

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* cool details

* composed chart, fixes

* fixes

* fixes

* fixes

* WIP HTTPS

* WIP HTTPS

* WIP HTTPS

* WIP HTTPS

* WIP HTTPS

* WIP HTTPS

* WIP new UserAvatar component

* fix

* tweaks

* tweaks

* WIP

* fix

* tweaks

* fix

* wip

* infra refacto : parallel deployment

* wip tests

* fix

* adjustment

* fix

* try something else

* wip

* adjustment

* try something cool

* fix

* fix

* fix

* cleaning

* cleaning

* cleaning

* cleaning

* mobile fixes

* WIP design enhancement. Refactoring front end to be digerable

* WIP confirmation code (email) with sendgrid

* missing sendgrid key in test env

* try something

* WIP ending email confirmation workflow

* WIP ending email confirmation workflow....

* adjustment

* fixes

* fixes

* add log

* fix

* fix

* fix

* fix

* fixes

* add admin feature : delete users !

* install boto3

* security for aws keys

* huge work on upload (use s3 bucket POC) - no use of db.images collection yet
edit env var to remove sensitive stuff
front end improvements

* WIP upload / fetch images (POC)

* fixes

* add elephant as admin

* add DTImage component

* update image view

* fix

* fix

* fix

* fix

* WIP Front Refactoring challenge

* WIP Front Refactoring challenge

* wip meta data on image object (size, width, height...)

* refactoring / cleaning

* fix

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
Co-authored-by: System Administrator <root@toms-4.home>
* enhance a lot Image component

* add delete image feature

* add size attribute for Image (front + back)

* fix

* add custom ImagesList component

* fix

* enhance image backend : add image compression, add width and height, refetch image size with new method. remove s3 helpers

* display image resolution

* fix

* refacto DTImage (add clickable prop)

* add mansonry layout on images !!

* add tabs

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* <3

* add useImages hook (+ ImagesContext.tsx). Add Tabs and stuff

* adjustments

* adjustments

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* add Labelisator.tsx skeleton

* rename Label -> FancyLabel

* rename Label -> FancyLabel

* TOOOOOOOOLS

* add Pagination

* WIP Labelisator (handling mouse event / drawRect)

* add Point type

* refactoring

* WIP labels state. Add Label type

* add drawLabels func

* drawLabels is now on DTImage (seriously this is awesome)

* add save labels dynamic button

* fix

* fix image height. Show label counter

* enhance UX

* WIP Tools

* WIP Tools (ToolMove: compute labels hovered)

* WIP Tools (handling moving labels, refacto, disable move tool if no labels)

* fix offset

* good fixes. Need to fix array of objects equals check !

* fixes

* cool fixes

* cool fixes

* micro fix

* WIP DTDataset styling

* fixes

* Refactoring | enhance labelisator ux, enhance snackbar and providers arch

* wip

* wip

* fix

* fix

* Clean code of Labelisator component. Rename. Add POC clear button

* KEYBOARD REFACTORING : add awesome useEventListener hook (new lib : `use-typed-event-listener`). add KeyboardShortcuts overlay component skeleton

* WIP KeyboardShortcuts (styling)

* fix

* adjustments

* add missing shortcuts

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* merge

* end front end for delete dataset

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
…ages from annotations instead of images folder
…ages from annotations instead of images folder
* enhance perf

* WIP InfiniteScroll (not done yet cause upload and delete are hard to handle with this behavior)

* cleaning

* add new shortcut (spacebar)

* fix

* fix

* fix

* render dots and resize cursor

* WIP label resize

* WIP front

* fix

* fix

* houston, we lost cursor animation, but we get reversible label drawing

* fix all for 1 label. multi labels is hard to handled and useless for resize, so need to erfacto currentLabelsResized

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
…ages from annotations instead of images folder
* clean

* coco dataset generation from url

* fix

* fix

* fix

* fix

* clean

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* fix

* enhance generator front end

* end generator front end

* fix

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
RuellePaul and others added 4 commits September 7, 2021 10:02
* Upgrade imports to `api` relative (e.g : import errors => from api import errors)

* Fix imports to `api` relative (e.g : import errors => from api import errors)

* Lint

* Lint

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* limit pipelines to 2 per dataset

* fix

* fix

* enhance readonly prop on Pipeline

* wip display operations pipeline on augmented images

* fix

* add delete pipeline feature

* add loader and fix

* add placeholder on datastet browse view

* add temp tabs for SectionImages

* WIP new component ImagesStack.tsx

* WIP integrating component ImagesStack.tsx

* fix react warns

* WIP refacto design SectionImages.tsx

* fancy session expired warn

* WIP refacto design SectionImages.tsx
2

* WIP refacto design SectionImages.tsx
3

* fix

* important fixes

* Refacto SectionImages........

* Security : post labels onyl if dataset is owned

* WIP Design

* fix

* fix

* fix

* fix

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* fix

* add ImagePreview.tsx component - refactoo - delete Labelisator in ImagesList /!\

* tweaks

* Add skeleton prop in DTImage

* Enhance menu for ImagePreview

* WIP Labelisator redesign

* WIP Labelisator redesign 2

* WIP Labelisator redesign 3

* WIP Labelisator redesign 4

* WIP Labelisator redesign 5

* WIP Labelisator redesign 6

* WIP Labelisator redesign 7

* WIP Labelisator redesign 8

* WIP Labelisator redesign 9

* WIP Labelisator redesign 9bis

* WIP Labelisator redesign 9ter (revert)

* WIP Labelisator redesign 10

* WIP Labelisator redesign 11 (add imperfect keyboard listener)

* WIP Labelisator redesign 11 (fix)

* WIP Labelisator redesign 12

* WIP Labelisator redesign 13

* WIP Labelisator redesign 14

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* unregister backend

* fix patch country

* end unregister front end

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
RuellePaul and others added 15 commits September 30, 2021 01:04
* Enhance front end for Labelisator

* add labels_count for categories

* fix wrong call

* renaming

* fix

* add new Categories component

* optimize find_categories (but still need to store labels count on the fly)

* WIP | Compute labels_count on the fly (for huge optimization load on large dataset).

✓ On POST /labels
✓ On DELETE /images/<image_id>
X On POST /task (generator)
X On POST /task (augmentor)
X On DELETE /pipelines

* End | Compute labels_count on the fly (for huge optimization load on large dataset).

✓ On POST /task (generator)
✓ On POST /task (augmentor)
✓ On DELETE /pipelines

* Enhance unregister front end

* Add placeholder for imagestack

* fix

* WIP SectionOVerview

* WIP SectionOverview

* WIP SectionOverview

* Section titles

* WIP SectionOverview : LabelisatorAction design

* WIP SectionOverview : tweaks

* WIP SectionOverview : tweaks

* WIP SectionOverview : tweaks

* Refactoring UI arch of Sections

* WIP Refactoring UI for Sections | Enhance code & clean

* Add ImageSlideshow component

* enhance 404 page

* Finally. Dynamic labelisation with tabs

* tweaks

* tweaks

* WIP images category filtering feature

* WIP images category filtering feature (use another CategoryProvider)

* End images category filtering feature, without lazy load end handled correctly

* fix

* fix

* fix

* Handle lazy load batches for images category filtering

* Fixes

* Add CategoriesDistribution chart

* tweaks and fixes

* tweaks and fixes

* tweaks and fixes

* fixes

* tweaks

* add search_unlabeled_image_id backend

* clean front end for next unlabeled

* handle pipeline in next unlabeled ! thats done

* add overlay prop on DTImage

* fixes & tweaks

* Add icons

* Tweaking

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* add meta data of fastapi

* add documentation boilerplate

* handle content first

* fix

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* Done essential of migration.

What is left :
- Palette & theming fixes
- Labelisator : fix nested mui menu
- Fix lint
- Pass on UI

* Add theme components overrides skeleton

* WIP SwaggerAPI

* WIP SwaggerAPI

* link

* Fix

* Enable Nested Menu Item again by adapting the lib to mui v5

* Lint

* tweaks

* tweaks

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* wip export feature (add skeletons & linking to front end)

* WIP Export feature

* WIP Export feature

* WIP Export feature

* tweak

* WIP ExportAction

* WIP ExportAction

* tweaks theme

* fix

* WIP ExportAction.tsx

* End ExportAction.tsx

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* WIP EditAction

* End EditAction

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* WIP Export as a task

* WIP exports router

* lint

* tweaking EditAction

* WIP LabelisatorAction

* fixes

* end ExportAction

* tweak ExportAction

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* tweaks

* tweaks

* tweaks

* tweaks

* fix

* WIP docs hierarchy

* fixes

* fixes

* Add category on overview

* fix

* fix

* typo

* tweaks

* tweaks

* more tweaks

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* add production builds dir (not committed), fix README

* add production builds dir (not committed), fix README

* gitignore

* front end env var

* add production backend config.py

* fixes

* fixes

* fixes

* fix

* test

* try

* printenv

* rm useless printenv

* fix

* try pythonpath in dockerfile

* fix

* try

* last try

* last last try

* last last last try

* fix

* last lastlastlast try

* back to relative imports (`api/`) in backend

* fix python version

* comment https nginx

* try

* add ssl certificate paths

* WIP

* enhance proxy container, change api URL

* temporary remove api.datatensor.io.conf

* revert & enhance previous

* fix previous

* fix frontend wrong uri

* fix

* update backend OAuth & access token env var

* update ws to wss in ux

* fix

* update admin user of production

* handle websock in nginx

* handle production S3 bucket (dtproductionbucket) & recaptcha production env var

* fix

* api certificates

* fix

* revert

* fix snackbar

* WIP celery container

* fix

* add rabbitmq container

* fix

* display task error message

* fix generator frontend

* fix generator backend

* fix sendgrid

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* hide KeyboardShortcuts in mobile

* show User in dataset main view header & use dataset created at

* enhance typo

* several fixes

* remove network mode host in docker compose

* fix ux port

* revert

* Remove overlay SettingsNotification.tsx

* tweaks

* tweaks

* tweaks

* fix

* tweak

* tweak

* enhance scrollbar of DashboardLayout

* enhance scrollbar of DocsLayout (Navbar only)

* enhance scrollbar of DocsLayout (content)

* enhance scrollbar of MainLayout

* tweaks

* tweaks

* continue tweaks

* tweaks

* tweaks

* Finally good scrollbars

* tweaks

* tweaks

* tweaks

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* tweaks

* quickly add frontend dataset pagination

* tweaks

* tweaks (supercategories icon)

* tweaks

* WIP Refactoring SectionImages + tweaks

* fixes

* cleaning

* YESSS (painful providers resolution)

* fixes

* WIP Huge Scrollbar refactoring : upgrade masonry lib, remove infinite scrollbar one, fixes

* tweaks

* WIP virtualized masonry

* Revert "WIP virtualized masonry"

This reverts commit a5fb36c.

* Revert "Revert "WIP virtualized masonry""

This reverts commit 993ce3e.

* Revert "Revert "Revert "WIP virtualized masonry"""

This reverts commit 0b39c4d.

* Nice

* tweaks & allow images (from useImages) to be null

* enhance bottom Navigation on ImagesSection

* WIP SectionImages : add Actions (without placement), tweaks & fixes

* WIP SectionImages : remove actions & image preview, open labelisator on click image, enhance front

* WIP SectionImages : remove useless async, enhance frontend, handle scroll top

* WIP SectionImages

* fix

* Readd new overlay prop on DTImage

* Tweaks & fixes

* WIP add ImagesActionsMenu.tsx

* WIP add ImagesActionsMenu.tsx

* End ImagesActionsMenu.tsx

* tweaks

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* tweaks

* fixes

* WIP fixing URL hashes and history navigation

* tweaks

* Delete category is now in Overview, not in Labelisator

* fix slideshow width & console error

* WIP Responsive Labelisator : can't scroll on tools, can't scroll horizontally, disable auto swtich feature in mobile

* fix

* fix

* EXPERIMENTAL | Try multi touch labelisator on mobile

* EXPERIMENTAL | Try multi touch labelisator on mobile (WI        reset(canvas);
P)

* EXPERIMENTAL | Try multi touch labelisator on mobile (huge UX improvements)

* EXPERIMENTAL | fix

* EXPERIMENTAL | wip

* EXPERIMENTAL | wip

* fix

* handle touch end

* EXPERIMENTAL | Try to store last two points touched in a state

* EXPERIMENTAL | Fix previous : when touches count === 1 on handleTouchEnd, it means we touch end with second finger

* tweaks

* WIP ToolMove mobile

* fix

* temporarly redirect to datasets, as dashboard is not done

* VERY EXPERIMENTAL | Remove tools in mobile, all touch logic is handled by ToolMove

* app version

* add fixme

* add touch overlay

* fix

* try fix wrong bucket in prod

* WIP

* COLORS fixes

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* optimization

* enhance styling of Labelisator - final touches

* fix

* fix

* rename route

* WIP Rebranding everything

* WOWOWOWOWOW

* WIP Rebranding

* WIP Rebranding & new home (Made <Hero/>)

* fixes

* fixes

* tag version 0.9.34

* typo

* mobile design for Hero, tweaks

* tag 0.9.35

* fix

* Change color background colors on Home v2. Delete CookiesNotification.tsx

* https://localhost:5069/

* fix

* tag 0.9.36

* WIP Features

* WIP Features

* Huge advancement for Features section

* fix

* fix

* WIP FeatureLabeling
/!\ At this point we need to merge some component `LabelisatorContent`

* WIP FeatureLabeling again

* removeu unesed

* style for feature

* WIP FeatureAugmentation

* End FeatureAugmentation (backend)

* tweaks

* WIP Responsive

* Tweaks Responsive

* Rebranding Features

* fix

* fix

* enhancements (close to real computing of dynamic heights)

* fix export bug

* wip refactoring | enhance mobile

* wip refactoring | tweaks

* tweaks

* WIP enhance Dataset component

* add `include_categories` filter on /datasets route

* add all filters, drastically reducing API calls so incread speed

* handle filters for <Features>, add randomIndexes

* add FeaturesDatasets skeleton

* WIP Dataset

* add categories on Dataset

* fixes

* WIP FeatureDatasets.tsx

* add 2 more datasets in public data

* nice fixes

* fix

* important fix

* ui fixes

* uiiii vive le code dans le TGV 🤢

* Remove FAQS section

* fix

* CTA enhanced for merging

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* Add OAuth buttons in register view

* tweaks

* switch linkedin to github

* WIP ForgotPAssword front end

* WIP ForgotPAssword front end & backened

* WIP ResetPassword front end

* WIP ResetPassword front end

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* Add all docs pages skeleton

* enhance TopBar for DocsLayout

* Add nav buttons on each doc article

* fix

* WIP documentation content

* Add Image mdx

* tweaks

* Enhance documentation, add buymeacoffe page, fixes

* fix

* fix weird fastapi bug

* fix

* fir guest guard admin redirection

* Add a lot of tweaks for frontend : enhance <Autocomplete/>, enhance <Results/>, add skeleton, enhance loading states

* Tweaks

* Add OwnDatasets

* fix

* WIP

* WIP responsive for <Filter/> (/datasets)

* End tweaking /datasets view

* fixes

* tweaks

* Refacto DatasetMainView page : remove tabs, enhance design, move augmentation feature in images actions

* Tweaks

* Tweaks

* Refactored sample on datasets to do 3x3 images

* Add <Skeleton/> masonry for Sample

* Refactor DatasetActions to use Mui Stepper

* Labelisator tweaks

* More Labelisator tweaks

* Lint

* tweaks

* Refactoring export to be synchronous (for large datasets)

* Raise api nginx timeout to 30min (experimental)

* Tweaks export front end, fixes

* Remove NotImplemented dashboard page

* WIP documentation content

* tweaks

* Clean DatasetCreateView

* WIP documentation content

* Add app. et docs. nginx confs - Temporary remove certificates from proxy

* Temporary remover ssl

* Temporary remove http to https directive

* fix api nginx temp conf

* try acme challenge rule in nginx conf

* WIP try acme challenge rule in nginx conf

* WIP 2 try acme challenge rule in nginx conf

* WIP 3 try acme challenge rule in nginx conf

* WIP 4try acme challenge rule in nginx conf

* WIP 5 try acme challenge rule in nginx conf

* WIP 6 try acme challenge rule in nginx conf

* Enable SSL conf in nginx

* Fix syntax

* add /etc/letsencrypt volume

* fix nginx confs for subdomains

* experimental (nginx app & docs conf)

* fix previous

* app.datatensor.io.conf: WIP

* allows app. et docs. in CORS

* enhance http to https

* experimental : serving docs

* experimental : serving docs 2

* experimental : serving docs 3

* experimental : serving docs 4

* experimental : serving docs 5

* experimental : serving docs 6

* experimental : serving docs 7

* experimental : serving docs 8

* experimental : serving docs 9

* experimental : serving docs 10

* experimental : serving docs 11

* experimental : serving docs 12

* experimental : serving docs 13

* experimental : serving docs 14

* experimental : serving docs 15 (add LocationReset & change routes)

* experimental : serving docs 16 (fix LocationReset - localStorage only of app scoped)

* experimental : serving docs 17 (fixes LocationReset)

* experimental : serving docs 18 (change localStorage for cookie for access token)

* experimental : serving docs 19 (fixes)

* experimental : serving docs 20 (fixes)

* WIP fixes subdomains nightmare. Simplify logo

* fix

* fix

* WIP - Try sharing user across domains

* WIP - Try sharing user across domains 3 (remove cookie user - rely on refresh on domain - i.e hostname - changes)

* Revert | only works for datatensor.io & app.datatensor.io. For some reason docs.datatensor.io doesn't fetch

* Feature/refacto augmented images (#76)

* Refactoring | Augmented images relies now on new key `original_image_id`. Remove PipelineProvider. Fixes

* Refactoring | Important fixes & tweaks

* Refactoring | fix

* Refactoring | tweaks

* Refactoring | important fixes on image_count & augmented_count, on deletion

* Refactoring | tweaks

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>

* Fin public sample

* Optimize backend of include_labels. Fetch long call /imageIds only on labelisator opening.

* Fix name

* Fixes

* Add UploadImages section on docs, + enhance docs `Image` component

* Add Labeling section on docs. Commit new gifs

* increase HEARTBEAT_DELAY in production

* use video tag instead of <img> gif for docs views

* Add task export. isPaused is now exported form TasksContext. Add TaskProgress component

* fix

* fix

* Move notifications ws poll in Notifications component

* Fixes

* Other fixes

* tweaks

* tweaks

* Add shift key for labelisator

* fixes

* change export structure for performance

* rebranding logo, fixes fallbacks

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
@RuellePaul RuellePaul self-assigned this Feb 21, 2022
RuellePaul and others added 5 commits March 15, 2022 23:54
* WIP ELK : logstash.conf & docker stuff.
Instantiate EC2 nano instance

* fix

* fix

* fix

* move stuff

* move stuff

* WIP ELK

* WIP ELK

* WIP ELK

* fix

* try hiding kibana port behind proxy

* fix

* try serving front for kibana http subdomain

* add ssl for kibana subdomain

* fix kibana port

* fix logstash.conf

* elk migration and security

* migrate to elk stack version 8.1.0

* fix

* add kibana.yml

* update kibana.yml

* update kibana.yml : server.port and server.host back to default

* revert

* revert

* fix

* add test passwords (for local env)

* move elk in builds/production. gitignore .env to setup correctly in prod

* try to add logstash & filebeat

* fix

* fix

* enable SSL for logstash

* enable SSL for logstash bis

* remove SSL logstash

* default config logstash

* revert

* fix

* fix

* fix

* fix

* fix cert path

* fix cert path

* fix cert path

* fix cert path

* fix cert path

* fix

* use direct volume path

* revert

* wip

* wip

* remove temp logstash & filebeat

* Revert "remove temp logstash & filebeat"

This reverts commit b15da5c.

* fix

* Add logs for every route of every router, with model `<Router> | <Message>`

* Remove docker metadata processor

* Grok filter update : parse router & message

* logstash.conf : use root elastic user with env var password

* change index before final config elk deployment

* grok parse timestamp ISO8601 and log_level

* change timezone of logs to "Europe/Paris"

* change `message` fro `parsed_message` in grok filter (conflict with native `message`)

* escape pipe char
🤯 grok i hate you

* change grok type DATA -> GREEDYDATA for parsed_message field

* handle & parse error logs

* update readme with some reminders

* fix

* add traceback route

* change API version

* add kibana export (saved objects : 1 dashboard, 2 searches, 1 index)

* fix

* fix

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* try fix docker pull github packages

* temp hardcoding for test

* fix

* Enhance vertical stepper front-end

* Public images compression

* Feature/Add Google One Tap feature (#78)

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>

* fix OneTapLogin presence on non public pages

* WIP SectionAugmentation rebranding

* WIP SectionAugmentation rebranding

* WIP SectionAugmentation rebranding

* Add supercategory icon on DTCategories - WIP gifs augmentation operations

* Enhance Operation UX

* WIP SectionAugmentation rebranding - Enhance Sample - fixes

* WIP Pipeline style

* WIP Pipeline style

* WIP Pipeline style

* display 4 images per dataset

* fix

* fixes

* fixes

* fixes

* fix

* set cookie httponly

* fix

* add /logout route

* try

* remove subdomains issues by removing subdomains. 🖕

* label highlighting, manage category providers

* tweaks

* WIP Removing tasks context outside dataset main view

* cert renewal | wip

* cert renewal | wip 2

* cert renewal | try

* cert renewal | try 2

* cert renewal | try 3

* cert renewal | try 4

* front end tweaks

* front end tweaks

* WIP AugmentorTool rebranding, add MAX_OPERATIONS_PER_PIPELINE, tweaks

* WIP AugmentorTool rebranding, rename

* Add new component TaskSnackbar. Delete old components related to Task (TaskDetails & WorkingAlert)

* export export rom task types

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* enhance perfs of Hero section

* remove ImagesSlideshow component

* WIP Features section

* compress images, fixes

* Add more public data for `Bullets impact` public dataset, compress images again, + some tweaks on Features section

* Animate svg with some dashes magic (share.svg)

* WIP labeling.svg and FeatureLabeling rebrand. Tweaks

* WIP FeatureLabeling rebrand

* WIP FeatureAugmentation rebrand

* Responsive for Features component

* Responsive for Features Buttons, + enhance brain injuries dataset

* Remove augmented image in public data

* Only 1 image preview for datasets

* Enhance space-girl.svg animation. Enhance create dataset view

* Enhance SectionOverview

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* WIP new Footer Skeleton

* Enhance Footer styles

* add links & fixes

* Add Terms and Privacy skeletons

* fix

* Add NewsletterForm component (front & back)

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
* Add IP address (from X-Forwarded-For nginx directive), and log on /public route

* fix

* debug

* try

* fix

Co-authored-by: Paul Ruelle <paul.ruelle@widmee.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants