search

data-engineering-community / data-engineering-wiki

The best place to learn data engineering. Built and maintained by the data engineering community.
https://dataengineering.wiki
Creative Commons Zero v1.0 Universal
1.21k stars 120 forks source link

Feature: Project section? #40

Closed digitalghost-dev closed 6 months ago

digitalghost-dev commented 7 months ago

Hey, I've noticed that the subreddit for r/DataEngineering tends to have the same question over and over about projects and people asking for examples. How about adding a section in the wiki for people's open source data engineering projects?

JPHaus commented 7 months ago

Yeah, I like that idea. It would be nice if it were tagged and filterable but I don't think that's a hard requirement. We do have a link that comes up if you search project but it would be better if there were a standalone page. I've also tinkered around in the past with a little project idea generator app.

image

So I guess the easiest thing to do would be to have a table or use airtable for filtering functionality and just put it on a page (probably under community). I can make the page/add to airtable and if you're up for it I could use some help with sourcing which projects to display.

digitalghost-dev commented 7 months ago

Yeah, I can start sourcing some projects and make a list.

digitalghost-dev commented 7 months ago

@JPHaus - any sort of criteria you are looking for? I was thinking of maybe making a post on the subreddit about this as well instead of searching manually for a list. Let me know what you think about that.

JPHaus commented 7 months ago

I was originally thinking about filtering posts by the project showcase flair and selecting some of the top voted posts to start. It would be nice to have them tagged by the tools because I assume folks would want to search by that to get ideas but it's also a lot of manual work.

I like your idea of sourcing them from the community instead of making the list yourself. If you don't mind making a post that would be greatly appreciated and I can share the post with the other networks.

digitalghost-dev commented 7 months ago

Alright, the post is live. If you want me to make any sort of edits, please let me know.

digitalghost-dev commented 7 months ago

Didn't seem to get any responses on the post. So, I was thinking that I can search for and get a list of 5 just to start.

digitalghost-dev commented 6 months ago

Okay, I think I have a starter list:

JPHaus commented 6 months ago

Thanks for putting that together! I'll add it to a page later today or this weekend.