search

adrienpoly / rubyvideo

Indexing all Ruby related videos
https://rubyvideo.dev
185 stars 29 forks source link

Looking for a conference to contribute to `rubyvideo.dev`? Start here! #34

Open marcoroth opened 1 year ago

marcoroth commented 1 year ago
PedroAugustoRamalhoDuarte commented 1 year ago

RailsConf 2023 is out, i can help inserting that data. Is there any automatic script to build the .yml?

marcoroth commented 1 year ago

Hey @PedroAugustoRamalhoDuarte, as Adrien mentioned the scripts are not quite ready yet. But I saw you were able to still get up and running. I also added the RailsConf 2023 playlist to the list above. Thank you!

adrienpoly commented 10 months ago

some preliminary scripts are available here #60. Still need to polish the parsers for the various cases but it does help

zverok commented 9 months ago

I had a similar idea to this repo some time ago. I started by taking a list of conferences from https://rubyconferences.org/ GitHub sources, then made a few scripts to enrich it with links to playlists, then, fetched the data from target sites to automatically fill the details for every playlist video where it was available.

Then I abandoned the project (well, actually, planned to get back to it eventually, but now I don't want to duplicate the active effort of this repo), but I still have my YAML files. I want to share them, and I hope they would be helpful.

A sad note: when I started, there was a confreaks.tv site, with all the conferences the Confreaks team have recorded, with a nice API and organization, so I took a lot of info from there, and used it as a canonical URLs. Unfortunately, they have shut it down since (they say that all the videos is on their YouTube, but I think I found at least one conference which was on confreaks.tv, but not on YouTube). The site at least is still available on Wayback Machine.

Anyway, the data is here: rubyconferences-zverok.zip

The structure is:

conferences.yml:

A linear list of known conferences:

# ...
- name: RubyConf Uruguay
  location: Montevideo, Uruguay
  start_date: 2014-05-23
  end_date: 2014-05-24
  url: http://web.archive.org/web/20150105045157/http://www.rubyconfuruguay.org:80/en
  twitter: rubyconfuruguay
  video_link: https://www.youtube.com/playlist?list=PLxx5qlTQCf0zx-DIFVHlftznHExI7ONEV

- name: 'RubyMotion #inspect'
  location: San Francisco, CA
  start_date: 2014-05-28
  end_date: 2014-05-29
  url: http://www.rubymotion.com/conference/2014/
  twitter: rubymotion
  video_link: http://confreaks.tv/events/inspect2014
# ...

(Where video_link is a link where the data can be extracted)

grouped.yml

The same list, grouped by the conference title:

- name: Rubyfuza
  events:
  - year: 2014
    name: Rubyfuza
    location: Cape Town, South Africa
    start_date: 2014-02-06
    end_date: 2014-02-08
    url: http://www.rubyfuza.org/2014/
    twitter: rubyfuza
    video_link: http://www.confreaks.com/events/rubyfuza2014
  - year: 2015
    name: Rubyfuza
    location: Cape Town, South Africa
    start_date: 2015-02-05
    end_date: 2015-02-06
    url: http://www.rubyfuza.org/2015/
    twitter: rubyfuza
    video_link: https://www.youtube.com/playlist?list=PLI113oIao_x63Ne1S8ObKYQwbPRcpb8kN
# ...

conferences/{youtube,confreaks}/<conference_handle>.yml

All the metainformation from videos from the conference, however the target site returned it.

conferences/youtube/_parsed.yml

The normalized info from all the YouTube files, with author names extracted, description cleaned up and so on (I had many per-conference patterns to do that), like this:

wroc_love-rb2014:
- title: Robert Pankowecki - DEVELOPER ORIENTED PROJECT MANAGEMENT
  description: |-
    This video was recorded on http://wrocloverb.com. You should follow us at https://twitter.com/wrocloverb. See you next year!

    http://pankowecki.pl/wrocloverb2014/index.html#/

    Robert Pankowecki with DEVELOPER ORIENTED PROJECT MANAGEMENT

    Do you work on projects managed in a way that is easiest for managers or customers? Focused around their priorities without taking developers needs into account? Can we strive to achieve work and project environment that would be friendly for programmers so that they enjoy working in our company and don't think about leaving it?
    The first part of this talk is intended to demonstrate techniques for managing IT projects in a developer friendly way. So that developers can avoid feeling of burden and disconnection from the rest of the team. So that they can improve their skills and grow up in new areas, without stagnating in doing the same repetitious tasks and working on fenced areas of code. And so that they can be always sure that they are working on the most important task right now and avoid confusion.
    It will be based on guidelines that we established at Arkency throughout years of working remotely. You can apply them to your project slowly and every one of them will help you improve some of the previously mentioned aspects. Together they make tremendous difference and let people enjoy a lot of benefits that a programming job can offer. They create a programmer friendly environment in which they can feel comfortable and productive. After all, IT teams mostly consists of programmers, so the project should be optimized for their efficiency and happiness. But it also creates a nice set of rules that makes the communication between customers, product owners and developers easier.
    But that's not all. Agile provides great opportunity for people to step forward and become leaders. But do you and your company know how to let people enter the path of leadership? How to empower the developers so they can introduce changes that make them more effective? The second part of the talk will show how developers can play the role of project managers. Your company might not become second Valve or Github but you can certainly benefit from applying changes leading towards more flat organization structure. By delegating at least some of the classic project manager actives such as meeting with clients, prioritizing tasks and extracting stories to programmers, they are given a chance to understand the business side of the project more deeply and to collaborate directly with the customer. With the technical and business knowledge, programmers can become true leaders for the projects, capable of independently handling issues and delivering the results, without the need for much supervision.
  speaker: Robert Pankowecki
  topic: DEVELOPER ORIENTED PROJECT MANAGEMENT

(Confreaks-sourced data in data/confreaks/ already had metadata organized in conference-author-title-description, so it didn't need any parsing.)

omonyms.yml

A small (manually created) list of how different conferences titled the same author, for deduplication, like:

Yukihiro Matsumoto:
- Yukihiro Matz Matsumoto
- Yukihiro 'Matz' Matsumoto
- Yukihiro "Matz" Matsumoto
- Matz
- Yukihiro Matzumoto

Hope this data would be useful.

adrienpoly commented 9 months ago

@zverok Thanks a lot for this data I'll get a detailed look into it and try to extract as much as possible. I agree that the transition from confreaks.tv to Youtube doesn't simplify

PS : thanks for your contribution to the Ruby language