portable biometric-based trust

[synctext]

Hacking Lab assignment TUDelft

Fingerprints are a fascinating way of identification. Biometric identification is a key primitive that is able to create trust in a large variety of scenarios. This project is focused on demonstrating that primitive in a specific practical scenario: a secure secret meeting.

The problem scenario is meeting people in a remote location and establishing their identity without the danger of an analog man-in-the-middle attack. Within this scenarios passports can’t be relied on, they can be falsified. You will hack together an Android app designed to identity people with extensive measures for tamper-resistance.

You will use the tamper-proof blockchain developed at TUDelft to store encrypted fingerprint images. You will design a procedure to arrange and securely identify members secure meeting members. You can assume, for instance, that encrypted fingerprints of all participants are stored beforehand on the Delft blockchain, Out-of-band trust may be assumed, encrypted fingerprints on the blockchain are authentic. An important danger is the easily duplication of fingerprint data. Once your fingerprint data leaks, you need new fingers. You can assume any modern smartphone has the storage capacity to download a complete replicate of all fingerprints and locally search fingerprint data. This portability and lack of traceability provides makes your Android app very generic. In general your app and usage procedures should provide portable trust with biometric validation.

You are required to use the TUDelft blockchain-lab.org software for storage. If your hack is operational we will arrange a presentation of your work to the State Agency for Identity Data, responsible for Dutch passports. Semi-random list of available software: https://github.com/rtshadow/biometrics https://github.com/cloudmesh/example-project-nist-fingerprint-matching https://github.com/Mauin/RxFingerprint

Use fingerprint scanner, etc

[ipsamiotis]

@Saminobi

[deactivated-acc]

Hello I am also in the group

[Roccy]

@jorenham @luHub @jrauhamaa @Roccy

[Roccy]

@shashankpr

[synctext]

tasks for next week:

• Android fingerprint bitmap export
• Feature extraction
• database search

Existing software, compile it, and missing elements.

[synctext]

Please ignore the blockchain part for now, suggest focus on core fingerprint matters first. Blockchain solution by TUDelft:

• http://blockchain-lab.org
• docs: http://repository.tudelft.nl/islandora/object/uuid:59723e98-ae48-4fac-b258-2df99d11012c
• spec: https://github.com/Tribler/tribler/wiki/Multichain-specifications
• code: https://github.com/Tribler/tribler/blob/devel/Tribler/community/multichain/community.py

[jorenham]

Repo: https://github.com/jorenham/fingerblox

[jorenham]

App flow:

1. Read fingerprint and extract features
2. Hash features and find match in the blockchain (in the image the 2nd hash)
3. If found, continue, else, give feedback
4. Extract ID from hash (first n bits)
5. First k bits of ID is the position of the ID of the name
6. Find the name hash in the blockchain
7. Ask user to enter name
8. Hash the name, check if match
9. Give user feedback

[jorenham]

https://www.google.nl/search?q=bluetooth+fingerprint+scanner+android

[ipsamiotis]

Fingerprint Extraction:

• Example: https://www.youtube.com/watch?v=7VsMJI24mO8
• Steps: http://answers.opencv.org/question/6364/fingerprint-matching-in-mobile-devices-android-platform/

[synctext]

Task for final project prototype:

• reach the WOW factor: it simply works!
• Android app only (no special fingerprint scanner hardware needed)
• Step 1: within the app: record a white background
• Step 2: move your finger in the recording box
• Step 3: make picture recording
• Sift for fingerprint feature extraction
• Fingerprint Identification Using SIFT-Based Minutia Descriptors and Improved All Descriptor-Pair Matching
• This Polish algorithm does skeletonization
• Now the critical step of Minutiae recognition (crossing number method) within the Polish algorithm
• Android app remarks:
  • integrate OpenCV inside Android app, first Sift code or non-patent alternatives.
  • Best to do all processing within OpenCV if possible and not use the Polish Python code.
  • Delft Blockchain code in Python can be ignored for now, possibly link that within the final week of project.
  • Goal is operational app: OK to hardcode for 1 Android phone model camera (Nexus, S6, G5, etc.) For instance, require autofocus. Set fixed aperture lens from within the app.
  • ignore for now the dataset issue. No attention coming sprint on matching fingerprints with dataset, training, and testing. Just skeleton app sprint.

[jorenham]

Https://github.com/jorenham/fingerblox

[synctext]

https://github.com/noureldien/FingerprintRecognition Does it already exists ???? evaluate & study their code in detail, or fork it. DOCS • Fingerprint Recognition in runtime using images captured from mobile.

• Feature extraction using Gabor filter, redge orientation and SIFT. Feature matching using SIFT and RANSAC.

• This project is built using Java, Android and OpenCV. Also built in MATLAB.

• The project is done as a part of coursework for 'Advanced Computer Vision' subject, MSc Artificial Intelligence, University of Southampton.

[Roccy]

Using a fisheye/macro lens that can easily be put on a smartphone camera, a proper quality image can be taken of the fingerprint.

[synctext]

As discussed:

• important to have a wow-factor demo
• first step is camera focus problem (OK to really fix this with assembly hacking)
• background versus skin detection
• histogram equalization
• use dataset to bypass the camera problem in upcoming 2-week sprint
• extract phone capabilities, shown on screen
• expose the FocusArea and OnFocusNotification details
• use steps in the GUI, show intermediary results, instead of blocking for 6 seconds

From the existing app:

Raw fingerprint image
Make grayscale
Mask with ellipse
Histogram equalisation
Ridge orientation filter
Thresholding
Thinning
SIFT feature extraction
RANSAC matching

[jorenham]

https://github.com/jorenham/fingerblox/releases/tag/V0.1

[synctext]

Sorry, this unsigned release is not working for me. Please test on various phones and fix.

[synctext]

Works! The install procedure can hopefully be improved by bundling the lib. I successfully made a fingerprint picture of a round-shaped coffee cup. Impressive Zebra! Keep up this pace please..

[jorenham]

Biometric authentication on the blockchain apparently already exist: https://humaniq.co/

[synctext]

Cool. Surely they have a server in there somewhere for banking. good find.

''' Our open source stack and APIs will be available for startups and other businesses to build services on our core technologies to stimulate the ecosystem and circular economy even further. The Ethereum Blockchain APIS ad makes it easy for any business to easily adapt their service and plug it into Humaniq’s network to reach a huge, untapped audience. We will also be starting a fund to help grow and accelerate some of our young startup partners. '''

[synctext]

https://github.com/FingerJetFXOSE/FingerJetFXOSE https://github.com/search?utf8=%E2%9C%93&q=Fingerprint+Feature&type=

• progressive zebra processing
• 1000+ image dataset peformance analysis
• one finger from numerous angles
• repeatable feature extraction
• wow-factor animated GIF of user experience
• replace generic feature extraction with human fingerprint feature extraction

[synctext]

wow-factor animated GIF of user experience

Re-use play store listing in report for easy-to-understand explanation.

Difficulty is how to easily make a wow-factor graph out of an operational app. Please be inspired by other publications in this area. Copy their experimental approach if possible.

Report: intro, problem description, algorithms, prototype, and experimental results + conclusion.

Quoting Article 12, put focus on science side?

[jorenham]

@synctext I can't seem to upload another version to the Play Store unless we have a privacy policy URL. What should I enter there?

[synctext]

Current report : portable-biometric-based.pdf

[synctext]

Published final article: https://arxiv.org/abs/1706.03744

[thinhtp]

@synctext Hi sir, We can use fingerBlox for detect fingerprint classification in 5 types Tent arch, Arch, Whorl, Ulnar loop, radial loop, for faster matching algorithm. Can we do this, please?

[synctext]

@thinhtp You are very much invited to build upon this work! Have fun.

[synctext]

Closing this issue for now, until new students are available to work on this topic.