wisdomify storyteller

Explanation

This project is building reverse-dictionary of korean proverb with BERT based model (wisdomify) and to train the model the datasets are prepared and crawled (storyteller).

Technology Stacks

• wisdomify
  • pyTorch (python)
    • BERT based transformer model
  • Flask
    • Demo implementation
• storyteller
  • Selenium (python), request
    • crawling data

wisdomify posts

Following bullet points are wisdomify related study, develop logs.

• Version control for Dataset and model data (serialised file- eg → .ckpt, .pt, .mar)
  • Now wisdomify projects can control the version of dataset and model data.
• Torch_serve for better model serving
  • Now wisdomify projects can serve various model with torch serve. However, the docker container cannot be deployed on ainize server as it only exposes one port where the torchserve requires at least 2.

storyteller posts

Following bullet points are storyteller related study, develop logs.

• DB controller via SSH tunnel
  • Now storyteller can save crawled information to Orcale MySQL DB.