Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validation setup #13

Merged
merged 13 commits into from
Jan 4, 2019
Merged

Validation setup #13

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
93db421
Added Notebook for start validation setup
pshivraj Dec 21, 2018
23fed80
Update notebook with Final mAP
pshivraj Dec 21, 2018
a54d89c
Updated readme with current setup
pshivraj Dec 21, 2018
266f90a
Create test
pshivraj Dec 21, 2018
5c32452
Delete test
pshivraj Dec 21, 2018
929c681
Create test
pshivraj Dec 21, 2018
e3eb621
Delete test
pshivraj Dec 21, 2018
6e3b8d8
removed validation status from readme
pshivraj Dec 21, 2018
71d01cb
updated readme with current limitations
pshivraj Dec 21, 2018
f8846d9
update mAP score
pshivraj Dec 21, 2018
eb0be37
Update notebook without mAP conflict image
pshivraj Dec 21, 2018
3f948d9
Updated notebook with title formatted
pshivraj Dec 26, 2018
97e15c1
Fixed notebook title for first two images
pshivraj Dec 26, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions research/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,13 @@
# Research

**Owner**: [Purshottam Shivraj](https://github.com/pshivraj)

Current Research work has been around exploring and setting up validation setup for clomask using pre-defined validation images using [matterport](https://github.com/matterport/Mask_RCNN) implimentation.

Current validation setup is measured against mAP which is defined as average of the maximum precisions at different recall values and is benchmarked at **0.5676** based on the validation process explored in the [clomask_notebook](https://github.com/havanagrawal/clomask/blob/validation_setup/research/clomask_notebook.ipynb).

## Current limitation of model

### Matterport(default config)
* Slant bottles are not detected.
* Some bottle images having connected lables between them are merged as one causing single mask for two different bottles, throwing off mAP.
535 changes: 535 additions & 0 deletions research/clomask_notebook.ipynb
View file
Open in desktop

Large diffs are not rendered by default.