@BigDataTools profile picture
JetBrains Big Data Tools @BigDataTools

Big Data Tools is a new plugin for @IntelliJIDEA that offers intelligent coding assistance for Zeppelin notebooks, integrated Spark and other tools for Big Data

Joined July 2019
  • Tweets 166
  • Following 44
  • Followers 2,056
34 Photos and videos
JetBrains Big Data Tools retweeted
JCP@jcp_org
12 Sep 2024
So excited to announce #JCPNewsLetter is returning! Here's the summer 2024 edition. Read about what is going on with the #JCP and #Java community! ow.ly/1xgM50TmiYN #JCPEC #JCPECElection #JCPAward #JSRupdate #JavaInEducation #JavaEcosystem #25YearsOfJCP
14
23
2,599
JetBrains Big Data Tools retweeted
JetBrains DataSpell@dataspell_jb
14 Apr 2023
Meet JetBrains at @PyConDE in Berlin! Members of the DataSpell, @pycharm, @datalore and @BigDataTools teams will be available April 17-19 at booth 21. Please drop by and say hello. #PyConDE #PyDataBerlin 2023.pycon.de/

PyCon.DE & PyData Berlin, 2023

Over the span of 3 days, attendees will have the opportunity to participate in workshops, attend live keynote sessions and talks, as well as get to know fellow members of the Python and PyData...

2023.pycon.de
1
4
1,782
Big Data Tools 2022.3 is now available with: ✅ AWS Glue Data Catalog support ☁️ Integration with Tencent Cloud Object Storage ✨Enhanced @ApacheZeppelin notebooks support Learn more and download👉 jb.gg/big-data-tools-2022-3

Big Data Tools 2022.3: Integration with AWS Glue Data Catalog, Code Completion for SQL Expressions...

In this update we've added integrations with AWS Glue, Tencent Cloud Object Storage, enhanced Zeppelin notebooks support, and delivered important fixes. Read on to learn about the most important chang

blog.jetbrains.com
2
7
The latest installment of Data Engineering Annotated is here with updates on: ⌚ Graph extension to Postgres 🪶 MPP from Apache 👁 C replacement for Apache Cassandra ...and many other topics. Check it out! jb.gg/4smdxu

1
1
2
JetBrains Big Data Tools retweeted
Trisha Gee@trisha_gee
6 Nov 2022
Good news everyone! @HelenJoScott and I have finally finished our book! For all you @intellijidea fans, we proudly present Getting To Know IntelliJ IDEA. The first 30 people to buy the book get a 50% discount #g2kij leanpub.com/gettingtoknowInt…

Getting to Know IntelliJ IDEA

Get up to speed on IntelliJ IDEA's New UI

leanpub.com
13
37
134
Hi everyone! Please help us in our research into @ApacheSpark usage patterns. Participate for a chance to win a one-year All Products Pack license! surveys.jetbrains.com/s3/t1-…
1
4
In this edition of Data Engineering Annotated, we discuss LinkedIn's newly released versions of products useful for data engineers, including: 🌉 Brooklin 🗄️ Ambry 🫦 DuaLip Also, a potentially breaking change in Apache Spark ❌✨ jb.gg/ivpd96

Data Engineering Annotated Monthly – September 2022 | The Big Data Tools Blog

It’s been a very bustling two months in Berlin. Indeed, it’s been so busy that I had to skip the digests. I am now delighted to have the privilege of returning to the task of collecting for you the mo

blog.jetbrains.com
2
Big Data Tools 1.6 is here! 🙌 The highlights of this release include integration with Hive Metastore and the ability to monitor Flink jobs right inside your IDE. Read the blog post to learn more about the most notable updates in this release 👉 jb.gg/bdt-1-6
3
4
In this installment of Data Engineering Annotated: 🌺The resurrection of Ambari 🪩Impressions of ShardingSphere 🍀Improvements for Druid 📨Scaling streams from InLong You’ll also find proposals and a report on the data engineering landscape by @lakeFS! jb.gg/j2aaxw

Data Engineering Annotated Monthly – June 2022 | The Big Data Tools Blog

Hi, I'm Pasha Finkelshteyn, and I’ll be your guide today through this month’s news. I’ll offer my impressions of recent developments in the data engineering space and highlight new ideas from the wide

blog.jetbrains.com
1
2
4
Support for Hive Metastore will soon be coming to the Big Data Tools plugin. On the threshold of this event, let's take a moment to review what Hive Metastore is and why we need it: jb.gg/8bbwey

Why We Need Hive Metastore | The Big Data Tools Blog

Everybody in IT works with data, including frontend and backend developers, analysts, QA engineers, product managers, and people in many other roles. The data used and the data processing methods vary

blog.jetbrains.com
2
4
JetBrains Big Data Tools retweeted
lakeFS@lakeFS
20 Jun 2022
What’s the state of #dataengineering tools in 2022? Let’s explore! 🧵
1
17
40
Hello, fellow data engineers! It’s time for the new issue of Data Engineering Annotated, starring: 🪨 RocksDB 🪶 Feathr ✍️ Kafka ✨ Spark and 🪵 replicated logs! Check it out 👇 jb.gg/jcw2x6

Data Engineering Annotated Monthly – May 2022 | The Big Data Tools Blog

It's the start of June. That means it’s time to start taking summer vacations and enjoying some fresh juice alongside your fresh news! Hi, I'm Pasha Finkelshteyn, and I’ll be your guide through this m

blog.jetbrains.com
2
2
Did it happen to you that you found yourself digging inside Spark sources and output of "show" on @ApacheSpark dataframes? No more need for it if you use @ApacheZeppelin and the Big Dat Tools plugin! #ztools to the rescue!
0:36
3
4
Streaming support was one of the most popular requests for us to implement in the @kotlin API for @ApacheSpark . So we’ve added it in, as well as several other exciting features! Find out more 👇🏼 jb.gg/dtg2ba

Kotlin API for Apache Spark: Streaming, Jupyter, and More | The Big Data Tools Blog

Hello, fellow data engineers! It’s Pasha here, and today I'm going to introduce you to the new release of Kotlin API for Apache Spark. It's been a long time since the last major release announcements,

blog.jetbrains.com
8
35
In case if you missed the latest Data Engineering Annotated (there were technical reasons to do so), here is it! jb.gg/zn4sh5

Data Engineering Annotated Monthly – April 2022 | The Big Data Tools Blog

Long time no see! Sorry about the silence, but luckily we’re back. Hi, I'm Pasha Finkelshteyn, and I’ll be your guide through this month’s news. I’ll offer my impressions of recent developments in

blog.jetbrains.com
1
2
.@awscloud EMR is very powerful. It provides us with many tools. But sometimes, it can be challenging to access certain services – for example, Zeppelin or Ganglia. To do this, you need to build an SSH tunnel to each one… Big Data Tools plugin solves this issue!
0:39
2
The Big Data Tools 1.6 EAP is now available! Try it out by installing the latest plugin version on the 2022.2 EAP version of your IDE. Learn more: jb.gg/bdt-eap
1
The next big thing is coming to Kafka! ZooKeeper-less setups are already possible, now secure ZooKeeper-less setups!
Ismael Juma@ijuma
17 May 2022
With the introduction of a KRaft-based authorizer, it's easy to run secure Kafka clusters without ZooKeeper in Apache Kafka 3.2. And a KIP for marking KRaft as production ready has been posted for discussion: cwiki.apache.org/confluence/…
2
Do you have a lot of topics in your @apachekafka? We too! So now there is a way to quickly filter topics in #kafka producers/consumers!
0:30
7
There are plenty of connection properties in @apachekafka and sometimes it's not that easy to memorize them all. That's why we have properties autocompletion in the Connection Settings dialog for Kafka.
0:38
1
5
Load more