akherlan
commented
3 months ago Hello @Kanuj7,
Thank you for your suggestions and I really appreciate it.
This repository is a project portfolio with my clients which have been completed. With generosity, the source code for data collection was opened to be accessed by the public, but with the limitation of not including data results due to confidentiality and work ethics reasons.
There is always possibility to expand and update the programs in this repository to enrich the functionality.
However, I consider the process you are proposing to be too difficult for myself to carry out alone in my current capacity and abilities. I have a fairly strong background in engineering, programming, and research for app development, but very limited in anything else related to legality tracking.
If collaboration and partnership with various parties is possible, then this will be an interesting project. You can also contact me on email on my profile for quick response to discuss your interest in developing this data collection tool. Thank you for taking the time to pay attention to this project.
Regards,
Andi
Description:
Overview: The current repository focuses on collecting data from the Canadian portal for lawyers and paralegals (lso.ca) through directory scraping. This initiative aims to gather comprehensive information crucial for legal professionals and stakeholders. However, exploring the possibility of expanding this endeavor to include other countries' legal directories presents an exciting opportunity for broader data collection and analysis.
Rationale: Expanding the scope beyond Canada could significantly enhance the repository's value by providing a more extensive database of legal professionals from various jurisdictions. This would not only benefit legal practitioners seeking cross-border collaborations but also serve researchers, policymakers, and individuals seeking legal services internationally.
Exploring Expansion: Before proceeding with expansion, several considerations and procedures need to be addressed:
Research and Assessment: Conduct thorough research to identify prominent legal directories in target countries. Evaluate the feasibility and legality of scraping data from these directories, considering factors such as website terms of use, data accessibility, and compliance with relevant laws (e.g., data protection regulations).
Technical Feasibility: Assess the technical feasibility of scraping data from directories in other countries. Determine if the existing scraping methodology and tools can be adapted or if new approaches need to be developed to accommodate variations in directory structures and data formats.
Legal and Ethical Compliance: Ensure compliance with legal and ethical standards governing data scraping and usage in each target country. This may involve obtaining explicit consent from directory owners, adhering to data protection regulations (e.g., GDPR), and respecting intellectual property rights.
Data Standardization: Develop protocols for standardizing scraped data from different countries to maintain consistency and facilitate cross-country comparisons. Consider factors such as naming conventions, categorization of legal specialties, and language translations.
Collaboration and Partnerships: Explore opportunities for collaboration with legal organizations, academic institutions, or technology partners in target countries. Collaboration can provide valuable insights, resources, and support for expanding the repository's reach effectively.
Next Steps: To proceed with the exploration of expansion possibilities, the following steps are proposed:
Conclusion: Expanding the directory scraping initiative to include other countries holds immense potential to broaden the repository's impact and utility. By systematically addressing the considerations and procedures outlined above, we can explore new opportunities for enhancing access to legal information on a global scale.
Your inputs, insights, and contributions to this exploration are highly encouraged and welcomed.