How do I write data to InfluxDB v2.7 in batches using Golang?

Writing data to InfluxDB v2.7 in batches using Golang involves using the official InfluxDB client library for Go. Here's a step-by-step guide and a code example to illustrate how it's done efficiently:

1. Set up your Go environment and install the InfluxDB client:

- Ensure you have Go installed. If not, download and install it from the official Go website.

- Initialize a new Go module or use an existing one:

go mod init your_module_name

- Install the InfluxDB client library:

go get github.com/influxdata/influxdb-client-go/v2

2. Import Necessary Packages:

- In your Go file, import the required packages for working with InfluxDB:

import (
  "context"
  "fmt"
  "time"
  influxdb2 "github.com/influxdata/influxdb-client-go/v2"
  influxdb2api "github.com/influxdata/influxdb-client-go/v2/api"
)


3. Establish a Connection to InfluxDB:

- Create a new InfluxDB client, specifying the URL, token, organization, and bucket you want to use.

func main() {
  token := "YOUR_INFLUXDB_TOKEN"
  url := "http://localhost:8086"
  org := "YOUR_ORGANIZATION"
  bucket := "YOUR_BUCKET"

  client := influxdb2.NewClient(url, token)
  defer client.Close()

  writeAPI := client.WriteAPIBlocking(org, bucket)

   // Create and write batches using function, shown bellow.
  batchWriteData(writeAPI)
}


4. Create a function to batch write data:

- This function will generate example points, add them to write api and write them to InfluxDb.

func batchWriteData(writeAPI influxdb2api.WriteAPIBlocking) {
  for i := 0; i < 100; i++ {
    p := influxdb2.NewPointWithMeasurement("my_measurement").
      AddTag("location", "europe").
      AddField("temperature", float64(i+20)).
      AddField("humidity", float64(i+50)).
      SetTime(time.Now())

    err := writeAPI.WritePoint(context.Background(), p)
    if err != nil {
      fmt.Printf("Error during write: %v\n", err)
    }
    time.Sleep(100 time.Millisecond)
  }
}

5. Full Example Code:

package main

import (
  "context"
  "fmt"
  "time"
  influxdb2 "github.com/influxdata/influxdb-client-go/v2"
  influxdb2api "github.com/influxdata/influxdb-client-go/v2/api"
)

func main() {
  token := "YOUR_INFLUXDB_TOKEN"
  url := "http://localhost:8086"
  org := "YOUR_ORGANIZATION"
  bucket := "YOUR_BUCKET"

  client := influxdb2.NewClient(url, token)
  defer client.Close()

  writeAPI := client.WriteAPIBlocking(org, bucket)

  batchWriteData(writeAPI)
}

func batchWriteData(writeAPI influxdb2api.WriteAPIBlocking) {
  for i := 0; i < 100; i++ {
    p := influxdb2.NewPointWithMeasurement("my_measurement").
      AddTag("location", "europe").
      AddField("temperature", float64(i+20)).
      AddField("humidity", float64(i+50)).
      SetTime(time.Now())

    err := writeAPI.WritePoint(context.Background(), p)
    if err != nil {
      fmt.Printf("Error during write: %v\n", err)
    }
    time.Sleep(100 time.Millisecond)
  }
}

Important Considerations:

- Replace placeholders like "YOUR_INFLUXDB_TOKEN", "http://localhost:8086", "YOUR_ORGANIZATION", and "YOUR_BUCKET" with your actual InfluxDB connection details.

- The WriteAPIBlocking ensures that the write operations are blocking, meaning the program will wait for each write to complete. You can use WriteAPI for non-blocking writes.

- For higher throughput, consider using a buffer to batch multiple points together before sending them to InfluxDB in a single call.

By following this guide and code example, you can effectively write data to InfluxDB v2.7 in batches using Golang, optimizing performance and efficiency.

Learn more about this